Sep 01 11:59:00 devstack cinder-volume[76146]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 11:59:00 devstack cinder-volume[76146]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 11:59:00 devstack cinder-volume[76146]: we strongly recommend against using it for new projects. Sep 01 11:59:00 devstack cinder-volume[76146]: If you are already using Eventlet, we recommend migrating to a different Sep 01 11:59:00 devstack cinder-volume[76146]: framework. For more detail see Sep 01 11:59:00 devstack cinder-volume[76146]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 11:59:00 devstack cinder-volume[76146]: import eventlet # noqa Sep 01 11:59:02 devstack cinder-volume[76146]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76146) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 11:59:02 devstack cinder-volume[76146]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76146) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 11:59:02 devstack cinder-volume[76146]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76146) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 11:59:03 devstack cinder-volume[76146]: INFO dbcounter [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Registered counter for database cinder Sep 01 11:59:03 devstack cinder-volume[76146]: DEBUG oslo_db.sqlalchemy.engines [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76146) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 11:59:03 devstack cinder-volume[76146]: DEBUG dbcounter [-] [76146] Writer thread running {{(pid=76146) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 11:59:03 devstack cinder-volume[76146]: INFO cinder.rpc [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 11:59:03 devstack cinder-volume[76146]: INFO cinder.rpc [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_db.sqlalchemy.engines [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76146) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 11:59:04 devstack cinder-volume[76146]: INFO cinder.volume.manager [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Determined volume DB was empty at startup. Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG cinder.volume.manager [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76146) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 11:59:04 devstack cinder-volume[76146]: INFO cinder.volume.manager [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 11:59:04 devstack cinder-volume[76146]: WARNING stevedore.named [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 11:59:04 devstack cinder-volume[76146]: WARNING castellan.key_manager [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 11:59:04 devstack cinder-volume[76146]: WARNING cinder.keymgr.conf_key_mgr [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG cinder.volume.drivers.lvm [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76146) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_concurrency.processutils [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] CMD "cinder-rtstool verify" returned: 0 in 0.446s {{(pid=76146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_db.sqlalchemy.engines [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76146) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 11:59:04 devstack cinder-volume[76146]: INFO cinder.rpc [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 01 11:59:04 devstack cinder-volume[76146]: INFO cinder.rpc [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 01 11:59:04 devstack cinder-volume[76146]: WARNING stevedore.named [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 11:59:04 devstack cinder-volume[76146]: WARNING castellan.key_manager [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 11:59:04 devstack cinder-volume[76146]: INFO cinder.volume.manager [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_db.sqlalchemy.engines [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76146) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 11:59:04 devstack cinder-volume[76146]: INFO oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Starting 1 workers Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Started child 76301 {{(pid=76146) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Full set of CONF: {{(pid=76146) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] ******************************************************************************** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Configuration options gathered from: {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] ================================================================================ {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] allow_availability_zone_fallback = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] allow_compression_on_image_upload = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] allowed_direct_url_schemes = [] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76301]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] api_rate_limit = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] auth_strategy = keystone {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] az_cache_duration = 3600 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_availability_zone = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_host = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_name = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_stats_polling_interval = 60 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backup_api_class = cinder.backup.api.API {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backup_name_template = backup-%s {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backup_use_same_host = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backup_use_temp_snapshot = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] chap_password = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] chap_username = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cinder_internal_tenant_project_id = 46fc53ebbce643268f99df6d4ec1cb39 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cinder_internal_tenant_user_id = 9c73c27c81124f6b8c9a268bfb6fa066 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cloned_volume_same_az = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cluster = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] compression_format = gzip {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] compute_api_class = cinder.compute.nova.API {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] config_dir = [] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] config_source = [] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] control_exchange = openstack {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] debug = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] default_availability_zone = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] default_group_type = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] default_volume_type = lvmdriver-1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] disk_geometry = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] driver_client_cert = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] driver_client_cert_key = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] driver_data_namespace = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] driver_ssl_cert_path = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] driver_ssl_cert_verify = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] driver_use_ssl = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] enable_force_upload = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] enable_new_services = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] enable_unsupported_driver = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] enforce_multipath_for_image_xfer = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] filter_function = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance_api_insecure = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance_api_servers = ['http://192.168.122.29/image'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance_api_ssl_compression = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance_ca_certificates_file = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance_catalog_info = image:glance:publicURL {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance_certfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance_keyfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance_num_retries = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance_request_timeout = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] goodness_function = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] graceful_shutdown_timeout = 5 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] group_api_class = cinder.group.api.API {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] host = devstack {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] image_compress_on_upload = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] image_conversion_address_space_limit = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] image_conversion_cpu_limit = 60 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] image_conversion_disable = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] image_upload_use_cinder_backend = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] image_upload_use_internal_tenant = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] image_volume_cache_enabled = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] image_volume_cache_max_count = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] image_volume_cache_max_size_gb = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] init_host_max_objects_retrieval = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] instance_format = [instance: %(uuid)s] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] iscsi_target_flags = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] iscsi_write_cache = on {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] iser_helper = tgtadm {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] iser_ip_address = 192.168.122.29 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] iser_port = 3260 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] log_color = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] log_config_append = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] log_dir = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] log_file = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76301]: INFO cinder.volume.manager [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 01 11:59:04 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] log_options = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] log_rotate_interval = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] log_rotate_interval_type = days {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] log_rotation_type = none {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:04 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] max_age = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] max_logfile_count = 30 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] max_logfile_size_mb = 200 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] max_over_subscription_ratio = 20.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] message_reap_interval = 86400 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] message_ttl = 2592000 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] migration_create_volume_timeout_secs = 300 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] monkey_patch = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] monkey_patch_modules = [] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] my_ip = 192.168.122.29 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] no_snapshot_gb_quota = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] num_iser_scan_tries = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] num_shell_tries = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] num_volume_device_scan_tries = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] nvmeof_conn_info_version = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] nvmet_ns_id = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] nvmet_port_id = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] osapi_max_limit = 1000 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] osapi_volume_ext_list = [] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] osapi_volume_listen_port = 8776 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] osapi_volume_use_ssl = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] osapi_volume_workers = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] per_volume_size_limit = -1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] periodic_fuzzy_delay = 60 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] periodic_interval = 60 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] public_endpoint = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] publish_errors = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] quota_backup_gigabytes = 1000 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] quota_backups = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] quota_gigabytes = 1000 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] quota_groups = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] quota_snapshots = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] quota_volumes = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] rate_limit_burst = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] rate_limit_except_level = CRITICAL {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] rate_limit_interval = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] reinit_driver_count = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] replication_device = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] report_discard_supported = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] report_interval = 120 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] reservation_clean_interval = 86400 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] reservation_expire = 86400 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] reserved_image_namespaces = [] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] reserved_percentage = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] rpc_response_timeout = 120 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] run_external_periodic_tasks = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] scst_target_driver = iscsi {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] scst_target_iqn_name = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] service_down_time = 720 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] shell_completion = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] snapshot_name_template = snapshot-%s {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] snapshot_same_host = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] split_loggers = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] state_path = /opt/stack/data/cinder {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.049s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] storage_availability_zone = nova {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] storage_protocol = iSCSI {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] syslog_log_facility = LOG_USER {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] target_helper = lioadm {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] target_ip_address = 192.168.122.29 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] target_port = 3260 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] target_protocol = iscsi {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] target_secondary_ip_addresses = [] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] trace_flags = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] transport_url = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] until_refresh = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] use_chap_auth = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] use_default_quota_class = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] use_journal = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] use_json = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] use_multipath_for_image_xfer = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] use_stderr = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] use_syslog = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] verify_glance_signatures = enabled {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] volume_api_class = cinder.volume.api.API {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] volume_backend_name = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] volume_clear = zero {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] volume_clear_ionice = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:05 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] volume_clear_size = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] volume_copy_bps_limit = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] volume_dd_blocksize = 1M {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] volume_name_template = volume-%s {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] volume_service_inithost_offload = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] volume_usage_audit_period = month {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] zoning_mode = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_concurrency.disable_process_locking = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.auth_section = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.auth_type = password {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.auth_version = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.cache = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.certfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.include_service_catalog = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.insecure = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.interface = public {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.keyfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.memcache_password = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.memcache_username = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.region_name = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.service_type = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.29/identity {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.backend = dogpile.cache.null {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.backend_argument = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.backend_expiration_time = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.config_prefix = cache.oslo {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.debug_cache_backend = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.enable_retry_client = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.enable_socket_keepalive = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.enabled = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.expiration_time = 600 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.hashclient_retry_attempts = 2 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.memcache_dead_retry = 300 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.memcache_pool_maxsize = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.memcache_sasl_enabled = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.password = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.proxies = [] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.redis_db = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.redis_server = localhost:6379 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.retry_attempts = 2 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.retry_delay = 0.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.socket_keepalive_count = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.socket_keepalive_idle = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.socket_keepalive_interval = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.socket_timeout = 1.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.tls_allowed_ciphers = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.tls_cafile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.tls_certfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.tls_enabled = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.tls_keyfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cache.username = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] coordination.backend_url = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.asyncio_connection = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.asyncio_slave_connection = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.backend = sqlalchemy {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.connection = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack sudo[76306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 01 11:59:05 devstack sudo[76306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.connection_debug = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.connection_parameters = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.connection_recycle_time = 3600 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.connection_trace = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.db_inc_retry_interval = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.db_max_retries = 20 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.db_max_retry_interval = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.db_retry_interval = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.max_overflow = 50 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.max_pool_size = 5 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.max_retries = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.mysql_wsrep_sync_wait = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.pool_timeout = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.retry_interval = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.slave_connection = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.sqlite_synchronous = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.synchronous_reader = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] database.use_db_reconnect = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_tracing.insecure = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] profiler.connection_string = messaging:// {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] profiler.enabled = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] profiler.es_doc_type = notification {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] profiler.es_scroll_size = 10000 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] profiler.es_scroll_time = 2m {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] profiler.filter_error_trace = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] profiler.hmac_keys = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] profiler.sentinel_service_name = mymaster {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] profiler.socket_timeout = 0.1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] profiler.trace_requests = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] profiler.trace_sqlalchemy = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] profiler_jaeger.process_tags = {} {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] profiler_jaeger.service_name_prefix = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] profiler_otlp.service_name_prefix = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_policy.enforce_new_defaults = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_policy.policy_default_rule = default {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_policy.policy_file = policy.yaml {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] privsep_osbrick.group = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] privsep_osbrick.helper_command = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] privsep_osbrick.user = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cinder_sys_admin.group = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cinder_sys_admin.helper_command = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] cinder_sys_admin.user = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] service_user.auth_section = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] service_user.auth_type = password {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] service_user.cafile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] service_user.certfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] service_user.collect_timing = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] service_user.insecure = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] service_user.keyfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] service_user.send_service_user_token = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] service_user.split_loggers = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] service_user.timeout = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] service_user.tls_ciphers = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] service_user.tls_min_version = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance.auth_section = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance.auth_type = password {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance.certfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance.collect_timing = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance.insecure = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance.keyfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance.region_name = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance.split_loggers = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance.timeout = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance.tls_ciphers = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] glance.tls_min_version = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.backend_availability_zone = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.chap_password = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.chap_username = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.disk_geometry = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.driver_client_cert = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.driver_client_cert_key = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.driver_data_namespace = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.driver_use_ssl = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.extra_capabilities = {} {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.filter_function = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.goodness_function = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.iscsi_target_flags = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.iscsi_write_cache = on {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.iser_helper = tgtadm {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.iser_ip_address = 192.168.122.29 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.iser_port = 3260 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.lvm_share_target = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.lvm_type = auto {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.num_shell_tries = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.replication_device = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.report_discard_supported = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.reserved_percentage = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.target_helper = tgtadm {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.target_ip_address = 192.168.122.29 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.target_port = 3260 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.target_protocol = iscsi {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.trace_flags = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.unique_fqdn_network = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.use_chap_auth = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.volume_backend_name = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.volume_clear = zero {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.volume_clear_ionice = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.volume_clear_size = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_reports.file_event_handler = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_reports.log_dir = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.backend_host = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.chap_password = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.chap_username = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.disk_geometry = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.driver_client_cert = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.extra_capabilities = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.filter_function = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.goodness_function = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.iser_helper = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.iser_ip_address = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.iser_port = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.lvm_share_target = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.lvm_type = auto {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.num_shell_tries = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.replication_device = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.report_discard_supported = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.reserved_percentage = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.scst_target_driver = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.storage_protocol = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.target_helper = lioadm {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.target_ip_address = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.target_port = 3260 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.trace_flags = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.use_chap_auth = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.volume_clear = zero {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.volume_clear_size = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] lvmdriver-1.volumes_dir = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.ssl = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_notifications.driver = [] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_notifications.retry = -1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] key_manager.fixed_key = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican.barbican_api_version = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican.barbican_endpoint = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican.barbican_endpoint_type = public {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican.barbican_region_name = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican.cafile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican.certfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican.collect_timing = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican.insecure = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican.keyfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican.number_of_retries = 60 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican.retry_delay = 1 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican.send_service_user_token = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican.split_loggers = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican.timeout = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican.tls_ciphers = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican.tls_min_version = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican.verify_ssl = True {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican.verify_ssl_path = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican_service_user.auth_section = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican_service_user.auth_type = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican_service_user.cafile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican_service_user.certfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican_service_user.collect_timing = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican_service_user.insecure = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican_service_user.keyfile = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican_service_user.split_loggers = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican_service_user.timeout = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican_service_user.tls_ciphers = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] barbican_service_user.tls_min_version = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] vault.approle_role_id = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] vault.approle_secret_id = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] vault.auth_method = approle {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] vault.auth_path = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] vault.kv_mountpoint = secret {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] vault.kv_path = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] vault.kv_version = 2 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] vault.namespace = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] vault.root_token_id = **** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] vault.ssl_ca_crt_file = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] vault.timeout = 60.0 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] vault.token_file = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] vault.token_role = None {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] vault.use_ssl = False {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 11:59:05 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] ******************************************************************************** {{(pid=76146) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 11:59:05 devstack sudo[76306]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:05 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.337s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:05 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:05 devstack sudo[76312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:59:05 devstack sudo[76312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:05 devstack sudo[76312]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:05 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.283s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:05 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 11:59:05 devstack cinder-volume[76301]: INFO cinder.brick.local_dev.lvm [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 01 11:59:05 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:05 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:05 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:05 devstack sudo[76327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 11:59:05 devstack sudo[76327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:06 devstack sudo[76327]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:06 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.368s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:06 devstack cinder-volume[76301]: DEBUG cinder.brick.local_dev.lvm [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76301) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 01 11:59:06 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:06 devstack sudo[76464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:59:06 devstack sudo[76464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:06 devstack sudo[76464]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:06 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.596s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:06 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:06 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:06 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:06 devstack sudo[76660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:59:06 devstack sudo[76660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:07 devstack sudo[76660]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:07 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:07 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:07 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:07 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:07 devstack sudo[76758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 01 11:59:07 devstack sudo[76758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:07 devstack sudo[76758]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:07 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.270s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:07 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:07 devstack sudo[76840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 11:59:07 devstack sudo[76840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:07 devstack sudo[76840]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:07 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:07 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:07 devstack sudo[76923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 11:59:07 devstack sudo[76923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:07 devstack sudo[76923]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:07 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:07 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:07 devstack sudo[76926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:59:07 devstack sudo[76926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:08 devstack sudo[76926]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:08 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:08 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:08 devstack sudo[77010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:59:08 devstack sudo[77010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:08 devstack sudo[77010]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:08 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:08 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:08 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:08 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:08 devstack sudo[77014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:59:08 devstack sudo[77014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:08 devstack sudo[77014]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:08 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.332s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:08 devstack cinder-volume[76301]: INFO cinder.volume.drivers.lvm [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 01 11:59:08 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:08 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:08 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:08 devstack sudo[77110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:59:08 devstack sudo[77110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:09 devstack sudo[77110]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:09 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:09 devstack cinder-volume[76301]: DEBUG cinder.volume.drivers.lvm [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Updating volume stats {{(pid=76301) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 11:59:09 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:09 devstack sudo[77113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 11:59:09 devstack sudo[77113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:09 devstack sudo[77113]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:09 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:09 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:09 devstack sudo[77116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:59:09 devstack sudo[77116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:09 devstack sudo[77116]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:09 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:09 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:09 devstack sudo[77119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:59:09 devstack sudo[77119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:10 devstack sudo[77119]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:10 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:10 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:10 devstack sudo[77156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:59:10 devstack sudo[77156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:10 devstack sudo[77156]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:10 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:10 devstack cinder-volume[76301]: INFO cinder.volume.driver [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Driver hasn't implemented _init_vendor_properties() Sep 01 11:59:10 devstack cinder-volume[76301]: DEBUG cinder.volume.driver [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76301) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 11:59:10 devstack cinder-volume[76301]: DEBUG oslo_db.sqlalchemy.engines [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76301) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 11:59:10 devstack cinder-volume[76301]: DEBUG dbcounter [-] [76301] Writer thread running {{(pid=76301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 11:59:10 devstack cinder-volume[76301]: DEBUG cinder.db.api [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Building query based on filter {{(pid=76301) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 11:59:10 devstack cinder-volume[76301]: DEBUG cinder.image.image_utils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76301) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 11:59:10 devstack cinder-volume[76301]: INFO cinder.keymgr.migration [None req-2d4dc6c1-7be5-4c36-b8f6-17ab57ed43b4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 11:59:10 devstack cinder-volume[76301]: DEBUG cinder.volume.drivers.lvm [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Updating volume stats {{(pid=76301) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 11:59:10 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:10 devstack sudo[77163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 11:59:10 devstack sudo[77163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:10 devstack sudo[77163]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:10 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:10 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:10 devstack sudo[77166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:59:10 devstack sudo[77166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:11 devstack sudo[77166]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:11 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:11 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:11 devstack sudo[77169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:59:11 devstack sudo[77169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:11 devstack sudo[77169]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:11 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:11 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:11 devstack sudo[77175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:59:11 devstack sudo[77175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:11 devstack sudo[77175]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:11 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:11 devstack cinder-volume[76301]: DEBUG cinder.manager [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Notifying Schedulers of capabilities ... {{(pid=76301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 11:59:11 devstack cinder-volume[76301]: INFO cinder.volume.manager [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Driver initialization completed successfully. Sep 01 11:59:11 devstack cinder-volume[76301]: INFO cinder.manager [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Initiating service 2 cleanup Sep 01 11:59:11 devstack cinder-volume[76301]: INFO cinder.manager [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Service 2 cleanup completed. Sep 01 11:59:11 devstack cinder-volume[76301]: DEBUG cinder.service [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Creating RPC server for service cinder-volume {{(pid=76301) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 11:59:11 devstack cinder-volume[76301]: DEBUG cinder.service [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76301) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 11:59:11 devstack cinder-volume[76301]: INFO cinder.volume.manager [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 01 11:59:11 devstack cinder-volume[76301]: DEBUG cinder.volume.drivers.lvm [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Updating volume stats {{(pid=76301) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 11:59:11 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:11 devstack sudo[77178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 11:59:11 devstack sudo[77178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:12 devstack sudo[77178]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:12 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:12 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:12 devstack sudo[77184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:59:12 devstack sudo[77184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:12 devstack sudo[77184]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:12 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:12 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:12 devstack sudo[77187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 11:59:12 devstack sudo[77187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:12 devstack sudo[77187]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:12 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:12 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 11:59:12 devstack sudo[77192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 11:59:12 devstack sudo[77192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 11:59:12 devstack sudo[77192]: pam_unix(sudo:session): session closed for user root Sep 01 11:59:12 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 11:59:13 devstack cinder-volume[76301]: INFO cinder.volume.manager [None req-1f3a0e10-1e7f-4810-b3e5-f237cc0f813d None None] Driver post RPC initialization completed successfully. Sep 01 11:59:14 devstack cinder-volume[76146]: DEBUG dbcounter [-] [76146] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76146) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:59:22 devstack cinder-volume[76301]: DEBUG dbcounter [-] [76301] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:59:23 devstack cinder-volume[76301]: DEBUG dbcounter [-] [76301] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 11:59:52 devstack cinder-volume[76301]: DEBUG oslo_service.periodic_task [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Running periodic task VolumeManager._thread_info {{(pid=76301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 11:59:52 devstack cinder-volume[76301]: DEBUG cinder.volume.manager [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] thread count: 6 {{(pid=76301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 11:59:52 devstack cinder-volume[76301]: DEBUG cinder.volume.manager [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] thread info: [<_MainThread(MainThread, started 124818665443456)>, , , , , ] {{(pid=76301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:00:52 devstack cinder-volume[76301]: DEBUG oslo_service.periodic_task [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:00:52 devstack cinder-volume[76301]: DEBUG cinder.volume.drivers.lvm [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Updating volume stats {{(pid=76301) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 12:00:52 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:00:52 devstack sudo[82382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 12:00:52 devstack sudo[82382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:00:52 devstack sudo[82382]: pam_unix(sudo:session): session closed for user root Sep 01 12:00:52 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:00:52 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:00:52 devstack sudo[82385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 12:00:52 devstack sudo[82385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:00:52 devstack sudo[82385]: pam_unix(sudo:session): session closed for user root Sep 01 12:00:52 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:00:52 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:00:52 devstack sudo[82388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 12:00:52 devstack sudo[82388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:00:52 devstack sudo[82388]: pam_unix(sudo:session): session closed for user root Sep 01 12:00:52 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:00:52 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:00:52 devstack sudo[82391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 12:00:52 devstack sudo[82391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:00:53 devstack sudo[82391]: pam_unix(sudo:session): session closed for user root Sep 01 12:00:53 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:00:53 devstack cinder-volume[76301]: DEBUG cinder.manager [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Notifying Schedulers of capabilities ... {{(pid=76301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:00:53 devstack cinder-volume[76301]: DEBUG oslo_service.periodic_task [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Running periodic task VolumeManager._thread_info {{(pid=76301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:00:53 devstack cinder-volume[76301]: DEBUG cinder.volume.manager [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] thread count: 6 {{(pid=76301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:00:53 devstack cinder-volume[76301]: DEBUG cinder.volume.manager [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] thread info: [<_MainThread(MainThread, started 124818665443456)>, , , , , ] {{(pid=76301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:01:23 devstack cinder-volume[76301]: DEBUG dbcounter [-] [76301] Writing DB stats cinder:SELECT=1 {{(pid=76301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:01:23 devstack cinder-volume[76301]: DEBUG dbcounter [-] [76301] Writing DB stats cinder:UPDATE=1 {{(pid=76301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:01:52 devstack cinder-volume[76301]: DEBUG oslo_service.periodic_task [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:01:52 devstack cinder-volume[76301]: DEBUG cinder.volume.drivers.lvm [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Updating volume stats {{(pid=76301) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 12:01:52 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:01:52 devstack sudo[83903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 12:01:52 devstack sudo[83903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:01:52 devstack sudo[83903]: pam_unix(sudo:session): session closed for user root Sep 01 12:01:52 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:01:52 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:01:52 devstack sudo[83906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 12:01:52 devstack sudo[83906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:01:52 devstack sudo[83906]: pam_unix(sudo:session): session closed for user root Sep 01 12:01:52 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:01:52 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:01:52 devstack sudo[83925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 12:01:52 devstack sudo[83925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:01:52 devstack sudo[83925]: pam_unix(sudo:session): session closed for user root Sep 01 12:01:52 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:01:52 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:01:52 devstack sudo[83946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 12:01:52 devstack sudo[83946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:01:53 devstack sudo[83946]: pam_unix(sudo:session): session closed for user root Sep 01 12:01:53 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:01:53 devstack cinder-volume[76301]: DEBUG cinder.manager [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Notifying Schedulers of capabilities ... {{(pid=76301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:02:52 devstack cinder-volume[76301]: DEBUG oslo_service.periodic_task [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:02:52 devstack cinder-volume[76301]: DEBUG cinder.volume.drivers.lvm [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Updating volume stats {{(pid=76301) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 12:02:52 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:02:52 devstack sudo[85382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 12:02:52 devstack sudo[85382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:02:52 devstack sudo[85382]: pam_unix(sudo:session): session closed for user root Sep 01 12:02:52 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:02:52 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:02:52 devstack sudo[85388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 12:02:52 devstack sudo[85388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:02:52 devstack sudo[85388]: pam_unix(sudo:session): session closed for user root Sep 01 12:02:52 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:02:52 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:02:52 devstack sudo[85391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 12:02:52 devstack sudo[85391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:02:52 devstack sudo[85391]: pam_unix(sudo:session): session closed for user root Sep 01 12:02:52 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:02:52 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:02:52 devstack sudo[85395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 12:02:52 devstack sudo[85395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:02:53 devstack sudo[85395]: pam_unix(sudo:session): session closed for user root Sep 01 12:02:53 devstack cinder-volume[76301]: DEBUG oslo_concurrency.processutils [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:02:53 devstack cinder-volume[76301]: DEBUG cinder.manager [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Notifying Schedulers of capabilities ... {{(pid=76301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:02:53 devstack cinder-volume[76301]: DEBUG oslo_service.periodic_task [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] Running periodic task VolumeManager._thread_info {{(pid=76301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:02:53 devstack cinder-volume[76301]: DEBUG cinder.volume.manager [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] thread count: 6 {{(pid=76301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:02:53 devstack cinder-volume[76301]: DEBUG cinder.volume.manager [None req-d03ac440-12de-452a-b7a1-1975d62bc2fe None None] thread info: [<_MainThread(MainThread, started 124818665443456)>, , , , , ] {{(pid=76301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:03:23 devstack cinder-volume[76301]: DEBUG dbcounter [-] [76301] Writing DB stats cinder:SELECT=1 {{(pid=76301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:03:23 devstack cinder-volume[76301]: DEBUG dbcounter [-] [76301] Writing DB stats cinder:UPDATE=1 {{(pid=76301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:03:35 devstack cinder-volume[76146]: INFO oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Caught SIGTERM, stopping children Sep 01 12:03:35 devstack cinder-volume[76146]: DEBUG oslo_concurrency.lockutils [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Acquiring lock "singleton_lock" {{(pid=76146) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 12:03:35 devstack cinder-volume[76146]: DEBUG oslo_concurrency.lockutils [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Acquired lock "singleton_lock" {{(pid=76146) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 12:03:35 devstack cinder-volume[76146]: DEBUG oslo_concurrency.lockutils [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Releasing lock "singleton_lock" {{(pid=76146) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 12:03:35 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Stop services. {{(pid=76146) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 12:03:35 devstack cinder-volume[76146]: DEBUG oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Killing children. {{(pid=76146) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 12:03:35 devstack cinder-volume[76146]: INFO oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Waiting on 1 children to exit Sep 01 12:03:36 devstack cinder-volume[76301]: DEBUG oslo_concurrency.lockutils [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Acquiring lock "singleton_lock" {{(pid=76301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 12:03:36 devstack cinder-volume[76301]: DEBUG oslo_concurrency.lockutils [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Acquired lock "singleton_lock" {{(pid=76301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 12:03:36 devstack cinder-volume[76301]: DEBUG oslo_concurrency.lockutils [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Releasing lock "singleton_lock" {{(pid=76301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 12:03:36 devstack cinder-volume[76301]: WARNING amqp [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 12:03:36 devstack cinder-volume[76301]: WARNING amqp [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 12:03:36 devstack cinder-volume[76146]: INFO oslo_service.backend._eventlet.service [None req-d86498d8-2369-4f35-9a8c-a909c05cec81 None None] Child 76301 exited with status 0 Sep 01 12:03:37 devstack cinder-volume[86316]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 12:03:37 devstack cinder-volume[86316]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 12:03:37 devstack cinder-volume[86316]: we strongly recommend against using it for new projects. Sep 01 12:03:37 devstack cinder-volume[86316]: If you are already using Eventlet, we recommend migrating to a different Sep 01 12:03:37 devstack cinder-volume[86316]: framework. For more detail see Sep 01 12:03:37 devstack cinder-volume[86316]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 12:03:37 devstack cinder-volume[86316]: import eventlet # noqa Sep 01 12:03:39 devstack cinder-volume[86316]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86316) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 12:03:39 devstack cinder-volume[86316]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86316) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 12:03:39 devstack cinder-volume[86316]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86316) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 12:03:39 devstack cinder-volume[86316]: INFO dbcounter [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Registered counter for database cinder Sep 01 12:03:40 devstack cinder-volume[86316]: DEBUG oslo_db.sqlalchemy.engines [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86316) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 12:03:40 devstack cinder-volume[86316]: DEBUG dbcounter [-] [86316] Writer thread running {{(pid=86316) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 12:03:40 devstack cinder-volume[86316]: INFO cinder.rpc [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 12:03:40 devstack cinder-volume[86316]: INFO cinder.rpc [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 12:03:40 devstack cinder-volume[86316]: DEBUG oslo_db.sqlalchemy.engines [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86316) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 12:03:40 devstack cinder-volume[86316]: INFO cinder.volume.manager [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Determined volume DB was empty at startup. Sep 01 12:03:40 devstack cinder-volume[86316]: DEBUG cinder.volume.manager [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86316) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 12:03:40 devstack cinder-volume[86316]: INFO cinder.volume.manager [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 12:03:40 devstack cinder-volume[86316]: WARNING stevedore.named [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 12:03:40 devstack cinder-volume[86316]: WARNING castellan.key_manager [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 12:03:40 devstack cinder-volume[86316]: WARNING cinder.keymgr.conf_key_mgr [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 12:03:40 devstack cinder-volume[86316]: INFO cinder.volume.manager [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 12:03:40 devstack cinder-volume[86316]: DEBUG oslo_db.sqlalchemy.engines [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86316) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 12:03:42 devstack cinder-volume[86316]: INFO oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Starting 1 workers Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Started child 86543 {{(pid=86316) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Full set of CONF: {{(pid=86316) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] ******************************************************************************** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Configuration options gathered from: {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] ================================================================================ {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] allow_availability_zone_fallback = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] allow_compression_on_image_upload = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] allowed_direct_url_schemes = [] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] api_rate_limit = True {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] auth_strategy = keystone {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_availability_zone = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_host = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_name = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_stats_polling_interval = 60 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backup_api_class = cinder.backup.api.API {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backup_name_template = backup-%s {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backup_use_same_host = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backup_use_temp_snapshot = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] chap_password = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] chap_username = {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cinder_internal_tenant_project_id = 46fc53ebbce643268f99df6d4ec1cb39 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cinder_internal_tenant_user_id = 9c73c27c81124f6b8c9a268bfb6fa066 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cluster = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] compression_format = gzip {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86543]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] compute_api_class = cinder.compute.nova.API {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] config_dir = [] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] config_source = [] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] control_exchange = openstack {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] debug = True {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] default_availability_zone = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] default_group_type = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] default_volume_type = QuobyteHD {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] disk_geometry = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] driver_client_cert = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] driver_client_cert_key = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] driver_data_namespace = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] driver_ssl_cert_path = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] driver_ssl_cert_verify = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] driver_use_ssl = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] enable_new_services = True {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] enable_unsupported_driver = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] enabled_backends = ['QuobyteHD'] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] enforce_multipath_for_image_xfer = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] filter_function = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance_api_insecure = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance_api_servers = ['http://192.168.122.29/image'] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance_api_ssl_compression = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance_ca_certificates_file = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance_catalog_info = image:glance:publicURL {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance_certfile = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance_keyfile = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance_num_retries = 3 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance_request_timeout = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] goodness_function = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] graceful_shutdown_timeout = 5 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] group_api_class = cinder.group.api.API {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] host = devstack {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] image_compress_on_upload = True {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] image_conversion_address_space_limit = 1 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] image_conversion_cpu_limit = 60 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] image_conversion_disable = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] image_upload_use_cinder_backend = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] image_upload_use_internal_tenant = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] image_volume_cache_enabled = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] image_volume_cache_max_count = 0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] image_volume_cache_max_size_gb = 0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] init_host_max_objects_retrieval = 0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] instance_format = [instance: %(uuid)s] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] iscsi_target_flags = {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] iscsi_write_cache = on {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] iser_helper = tgtadm {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] iser_ip_address = 192.168.122.29 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] iser_port = 3260 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] log_color = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] log_config_append = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] log_dir = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] log_file = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] log_options = True {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] log_rotate_interval = 1 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] log_rotate_interval_type = days {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] log_rotation_type = none {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] max_age = 0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] max_logfile_count = 30 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] max_logfile_size_mb = 200 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] max_over_subscription_ratio = 20.0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] message_reap_interval = 86400 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] message_ttl = 2592000 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] migration_create_volume_timeout_secs = 300 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] monkey_patch = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] monkey_patch_modules = [] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] my_ip = 192.168.122.29 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] no_snapshot_gb_quota = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] num_iser_scan_tries = 3 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] num_shell_tries = 3 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] num_volume_device_scan_tries = 3 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] nvmeof_conn_info_version = 1 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] nvmet_ns_id = 10 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] nvmet_port_id = 1 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] osapi_max_limit = 1000 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] osapi_volume_ext_list = [] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] osapi_volume_listen_port = 8776 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] osapi_volume_use_ssl = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] osapi_volume_workers = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] per_volume_size_limit = -1 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] periodic_fuzzy_delay = 60 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] periodic_interval = 60 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] public_endpoint = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] publish_errors = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] quota_backup_gigabytes = 1000 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] quota_backups = 10 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] quota_gigabytes = 1000 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] quota_groups = 10 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] quota_snapshots = 10 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] quota_volumes = 10 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] rate_limit_burst = 0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] rate_limit_except_level = CRITICAL {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] rate_limit_interval = 0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] reinit_driver_count = 3 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] replication_device = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] report_discard_supported = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] report_interval = 120 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] reservation_clean_interval = 86400 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] reservation_expire = 86400 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] reserved_image_namespaces = [] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] reserved_percentage = 0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86543]: INFO cinder.volume.manager [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86543]: DEBUG cinder.volume.drivers.remotefs [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86543) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] rpc_response_timeout = 120 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] run_external_periodic_tasks = True {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] scst_target_driver = iscsi {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] scst_target_iqn_name = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] service_down_time = 720 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] shell_completion = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] snapshot_name_template = snapshot-%s {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] split_loggers = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] state_path = /opt/stack/data/cinder {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] storage_availability_zone = nova {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] storage_protocol = iSCSI {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] syslog_log_facility = LOG_USER {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] target_helper = lioadm {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] target_ip_address = 192.168.122.29 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] target_port = 3260 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] target_protocol = iscsi {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] target_secondary_ip_addresses = [] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] trace_flags = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] transport_url = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] until_refresh = 0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] use_chap_auth = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] use_default_quota_class = True {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] use_journal = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] use_json = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] use_multipath_for_image_xfer = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] use_stderr = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] use_syslog = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] verify_glance_signatures = enabled {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] volume_api_class = cinder.volume.api.API {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] volume_backend_name = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] volume_clear = zero {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] volume_clear_ionice = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] volume_clear_size = 0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] volume_copy_bps_limit = 0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] volume_dd_blocksize = 1M {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] volume_name_template = volume-%s {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] volume_service_inithost_offload = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] volume_usage_audit_period = month {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] zoning_mode = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_concurrency.disable_process_locking = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.auth_section = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.auth_type = password {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.auth_version = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.cache = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.certfile = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.include_service_catalog = True {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.insecure = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.interface = public {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.keyfile = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.memcache_password = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.memcache_username = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.region_name = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.service_type = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.29/identity {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.backend = dogpile.cache.null {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.backend_argument = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.backend_expiration_time = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.config_prefix = cache.oslo {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.debug_cache_backend = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.enable_retry_client = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.enable_socket_keepalive = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.enabled = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.expiration_time = 600 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.hashclient_retry_attempts = 2 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.memcache_dead_retry = 300 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.memcache_pool_maxsize = 10 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.memcache_sasl_enabled = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.password = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.proxies = [] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.redis_db = 0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.redis_server = localhost:6379 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.retry_attempts = 2 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.retry_delay = 0.0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.socket_keepalive_count = 1 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.socket_keepalive_idle = 1 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.socket_keepalive_interval = 1 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.socket_timeout = 1.0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.tls_allowed_ciphers = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.tls_cafile = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.tls_certfile = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.tls_enabled = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.tls_keyfile = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cache.username = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] coordination.backend_url = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.asyncio_connection = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.asyncio_slave_connection = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.backend = sqlalchemy {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.connection = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.connection_debug = 0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.connection_parameters = {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.connection_recycle_time = 3600 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.connection_trace = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.db_inc_retry_interval = True {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.db_max_retries = 20 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.db_max_retry_interval = 10 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.db_retry_interval = 1 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.max_overflow = 50 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.max_pool_size = 5 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.max_retries = 10 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.mysql_wsrep_sync_wait = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.pool_timeout = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.retry_interval = 10 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.slave_connection = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.sqlite_synchronous = True {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.synchronous_reader = True {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] database.use_db_reconnect = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_tracing.insecure = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] profiler.connection_string = messaging:// {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] profiler.enabled = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] profiler.es_doc_type = notification {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] profiler.es_scroll_size = 10000 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] profiler.es_scroll_time = 2m {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] profiler.filter_error_trace = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] profiler.hmac_keys = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] profiler.sentinel_service_name = mymaster {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] profiler.socket_timeout = 0.1 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] profiler.trace_requests = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] profiler.trace_sqlalchemy = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] profiler_jaeger.process_tags = {} {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] profiler_jaeger.service_name_prefix = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] profiler_otlp.service_name_prefix = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_policy.enforce_new_defaults = True {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_policy.policy_default_rule = default {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_policy.policy_file = policy.yaml {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] privsep_osbrick.group = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] privsep_osbrick.helper_command = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] privsep_osbrick.user = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cinder_sys_admin.group = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cinder_sys_admin.helper_command = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] cinder_sys_admin.user = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] service_user.auth_section = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] service_user.auth_type = password {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] service_user.cafile = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] service_user.certfile = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] service_user.collect_timing = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] service_user.insecure = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] service_user.keyfile = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] service_user.send_service_user_token = True {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] service_user.split_loggers = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] service_user.timeout = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] service_user.tls_ciphers = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] service_user.tls_min_version = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance.auth_section = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance.auth_type = password {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance.certfile = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance.collect_timing = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance.insecure = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance.keyfile = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance.region_name = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance.split_loggers = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance.timeout = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance.tls_ciphers = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] glance.tls_min_version = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.backend_availability_zone = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.chap_password = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.chap_username = {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.disk_geometry = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.driver_client_cert = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.driver_client_cert_key = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.driver_data_namespace = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.driver_use_ssl = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.extra_capabilities = {} {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.filter_function = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.goodness_function = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.iscsi_target_flags = {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.iscsi_write_cache = on {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.iser_helper = tgtadm {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.iser_ip_address = 192.168.122.29 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.iser_port = 3260 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.nas_host = {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.nas_login = admin {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.nas_mount_options = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.nas_password = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.nas_private_key = {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.nas_share_path = {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.num_shell_tries = 3 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.quobyte_volume_url = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.replication_device = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.report_discard_supported = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.reserved_percentage = 0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.target_helper = tgtadm {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.target_ip_address = 192.168.122.29 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.target_port = 3260 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.target_protocol = iscsi {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.trace_flags = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.unique_fqdn_network = True {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86543]: DEBUG cinder.volume.drivers.quobyte [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86543) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 12:03:42 devstack cinder-volume[86543]: WARNING cinder.volume.drivers.quobyte [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 12:03:42 devstack cinder-volume[86543]: WARNING cinder.volume.drivers.quobyte [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.use_chap_auth = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.volume_backend_name = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.volume_clear = zero {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86543]: DEBUG oslo_concurrency.processutils [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Running cmd (subprocess): mount.quobyte {{(pid=86543) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.volume_clear_ionice = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.volume_clear_size = 0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_reports.file_event_handler = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_reports.log_dir = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.backend_availability_zone = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.backend_host = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.chap_password = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.chap_username = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.chiscsi_conf = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.disk_geometry = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.driver_client_cert = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.driver_data_namespace = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.driver_use_ssl = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.extra_capabilities = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.filter_function = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.goodness_function = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.iser_helper = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.iser_ip_address = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.iser_port = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.iser_target_prefix = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.nas_host = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.nas_login = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.nas_mount_options = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.nas_password = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.nas_private_key = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.nas_share_path = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.nas_ssh_port = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.num_shell_tries = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.nvmet_port_id = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.replication_device = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.report_discard_supported = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.reserved_percentage = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.scst_target_driver = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.storage_protocol = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.target_helper = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.target_ip_address = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.target_port = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.target_prefix = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.target_protocol = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.trace_flags = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.use_chap_auth = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.volume_clear = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.volume_clear_size = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] QuobyteHD.volumes_dir = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.ssl = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_notifications.driver = [] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_notifications.retry = -1 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] key_manager.fixed_key = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican.barbican_api_version = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican.barbican_endpoint = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican.barbican_endpoint_type = public {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican.barbican_region_name = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican.cafile = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican.certfile = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican.collect_timing = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican.insecure = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican.keyfile = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican.number_of_retries = 60 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican.retry_delay = 1 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican.send_service_user_token = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican.split_loggers = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican.timeout = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican.tls_ciphers = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican.tls_min_version = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican.verify_ssl = True {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican.verify_ssl_path = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican_service_user.auth_section = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican_service_user.auth_type = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican_service_user.cafile = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican_service_user.certfile = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican_service_user.collect_timing = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican_service_user.insecure = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican_service_user.keyfile = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican_service_user.split_loggers = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican_service_user.timeout = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican_service_user.tls_ciphers = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] barbican_service_user.tls_min_version = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] vault.approle_role_id = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] vault.approle_secret_id = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] vault.auth_method = approle {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] vault.auth_path = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] vault.kv_mountpoint = secret {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] vault.kv_path = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] vault.kv_version = 2 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] vault.namespace = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] vault.root_token_id = **** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] vault.ssl_ca_crt_file = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] vault.timeout = 60.0 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] vault.token_file = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] vault.token_role = None {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] vault.use_ssl = False {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:42 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] ******************************************************************************** {{(pid=86316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 12:03:42 devstack quobyte-client[86544]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 12:03:42 devstack quobyte-client[86544]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 12:03:42 devstack cinder-volume[86543]: DEBUG oslo_concurrency.processutils [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] CMD "mount.quobyte" returned: 1 in 0.128s {{(pid=86543) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:03:42 devstack cinder-volume[86543]: DEBUG oslo_concurrency.lockutils [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86543) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:03:42 devstack cinder-volume[86543]: DEBUG oslo_concurrency.lockutils [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86543) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:03:42 devstack cinder-volume[86543]: DEBUG cinder.volume.drivers.quobyte [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=86543) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:03:42 devstack cinder-volume[86543]: INFO cinder.volume.drivers.quobyte [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 ... Sep 01 12:03:42 devstack cinder-volume[86543]: DEBUG oslo_concurrency.processutils [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 -c /etc/quobyte/client-cinder.cfg {{(pid=86543) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:03:42 devstack sudo[86545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 -c /etc/quobyte/client-cinder.cfg Sep 01 12:03:42 devstack sudo[86545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:03:43 devstack sudo[86545]: pam_unix(sudo:session): session closed for user root Sep 01 12:03:43 devstack cinder-volume[86543]: DEBUG oslo_concurrency.processutils [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.452s {{(pid=86543) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:03:43 devstack cinder-volume[86543]: INFO cinder.volume.drivers.quobyte [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 succeeded Sep 01 12:03:43 devstack cinder-volume[86543]: DEBUG cinder.volume.drivers.quobyte [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=86543) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:03:43 devstack cinder-volume[86543]: DEBUG oslo_concurrency.lockutils [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.467s {{(pid=86543) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:03:43 devstack cinder-volume[86543]: DEBUG oslo_concurrency.processutils [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=86543) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:03:43 devstack sudo[86616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:03:43 devstack sudo[86616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:03:43 devstack sudo[86616]: pam_unix(sudo:session): session closed for user root Sep 01 12:03:43 devstack cinder-volume[86543]: DEBUG oslo_concurrency.processutils [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.322s {{(pid=86543) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:03:43 devstack cinder-volume[86543]: INFO cinder.volume.driver [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Driver hasn't implemented _init_vendor_properties() Sep 01 12:03:43 devstack cinder-volume[86543]: DEBUG cinder.volume.driver [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9639739990234, 'free_capacity_gb': 1773.9639739990234, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86543) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 12:03:43 devstack cinder-volume[86543]: DEBUG oslo_db.sqlalchemy.engines [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86543) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 12:03:43 devstack cinder-volume[86543]: DEBUG dbcounter [-] [86543] Writer thread running {{(pid=86543) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 12:03:43 devstack cinder-volume[86543]: DEBUG cinder.db.api [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Building query based on filter {{(pid=86543) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 12:03:43 devstack cinder-volume[86543]: DEBUG cinder.image.image_utils [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86543) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 12:03:43 devstack cinder-volume[86543]: INFO cinder.keymgr.migration [None req-d6e0f0fc-c2f1-4765-a0ce-dd6e2b4f56b2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 12:03:43 devstack cinder-volume[86543]: DEBUG oslo_concurrency.lockutils [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86543) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:03:43 devstack cinder-volume[86543]: DEBUG oslo_concurrency.lockutils [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86543) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:03:43 devstack cinder-volume[86543]: DEBUG cinder.volume.drivers.quobyte [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=86543) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:03:43 devstack cinder-volume[86543]: DEBUG cinder.volume.drivers.quobyte [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=86543) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:03:43 devstack cinder-volume[86543]: DEBUG oslo_concurrency.lockutils [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86543) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:03:43 devstack cinder-volume[86543]: DEBUG oslo_concurrency.processutils [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=86543) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:03:43 devstack sudo[86642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:03:43 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:03:43 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root Sep 01 12:03:43 devstack cinder-volume[86543]: DEBUG oslo_concurrency.processutils [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.252s {{(pid=86543) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:03:43 devstack cinder-volume[86543]: DEBUG cinder.manager [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Notifying Schedulers of capabilities ... {{(pid=86543) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:03:43 devstack cinder-volume[86543]: INFO cinder.volume.manager [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Driver initialization completed successfully. Sep 01 12:03:43 devstack cinder-volume[86543]: INFO cinder.manager [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Initiating service 3 cleanup Sep 01 12:03:43 devstack cinder-volume[86543]: INFO cinder.manager [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Service 3 cleanup completed. Sep 01 12:03:43 devstack cinder-volume[86543]: DEBUG cinder.service [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Creating RPC server for service cinder-volume {{(pid=86543) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 12:03:43 devstack cinder-volume[86543]: DEBUG cinder.service [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86543) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 12:03:44 devstack cinder-volume[86543]: INFO cinder.volume.manager [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 12:03:44 devstack cinder-volume[86543]: DEBUG oslo_concurrency.lockutils [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86543) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:03:44 devstack cinder-volume[86543]: DEBUG oslo_concurrency.lockutils [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86543) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:03:44 devstack cinder-volume[86543]: DEBUG cinder.volume.drivers.quobyte [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=86543) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:03:44 devstack cinder-volume[86543]: DEBUG cinder.volume.drivers.quobyte [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=86543) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:03:44 devstack cinder-volume[86543]: DEBUG oslo_concurrency.lockutils [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86543) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:03:44 devstack cinder-volume[86543]: DEBUG oslo_concurrency.processutils [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=86543) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:03:44 devstack sudo[86650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:03:44 devstack sudo[86650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:03:44 devstack sudo[86650]: pam_unix(sudo:session): session closed for user root Sep 01 12:03:44 devstack cinder-volume[86543]: DEBUG oslo_concurrency.processutils [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.512s {{(pid=86543) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:03:44 devstack cinder-volume[86543]: INFO cinder.volume.manager [None req-e6502747-96f2-49ca-a89d-ea7f9947676c None None] Driver post RPC initialization completed successfully. Sep 01 12:03:47 devstack cinder-volume[86316]: INFO oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Caught SIGTERM, stopping children Sep 01 12:03:47 devstack cinder-volume[86316]: DEBUG oslo_concurrency.lockutils [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Acquiring lock "singleton_lock" {{(pid=86316) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 12:03:47 devstack cinder-volume[86316]: DEBUG oslo_concurrency.lockutils [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Acquired lock "singleton_lock" {{(pid=86316) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 12:03:47 devstack cinder-volume[86316]: DEBUG oslo_concurrency.lockutils [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Releasing lock "singleton_lock" {{(pid=86316) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 12:03:47 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Stop services. {{(pid=86316) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 12:03:47 devstack cinder-volume[86316]: DEBUG oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Killing children. {{(pid=86316) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 12:03:47 devstack cinder-volume[86316]: INFO oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Waiting on 1 children to exit Sep 01 12:03:48 devstack cinder-volume[86543]: DEBUG oslo_concurrency.lockutils [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Acquiring lock "singleton_lock" {{(pid=86543) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 12:03:48 devstack cinder-volume[86543]: DEBUG oslo_concurrency.lockutils [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Acquired lock "singleton_lock" {{(pid=86543) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 12:03:48 devstack cinder-volume[86543]: DEBUG oslo_concurrency.lockutils [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Releasing lock "singleton_lock" {{(pid=86543) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 12:03:48 devstack cinder-volume[86543]: WARNING amqp [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 12:03:48 devstack cinder-volume[86543]: WARNING amqp [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 12:03:48 devstack cinder-volume[86316]: INFO oslo_service.backend._eventlet.service [None req-67c3ad2c-76ea-4170-b759-38f34f712d18 None None] Child 86543 exited with status 0 Sep 01 12:03:48 devstack cinder-volume[86811]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 12:03:48 devstack cinder-volume[86811]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 12:03:48 devstack cinder-volume[86811]: we strongly recommend against using it for new projects. Sep 01 12:03:48 devstack cinder-volume[86811]: If you are already using Eventlet, we recommend migrating to a different Sep 01 12:03:48 devstack cinder-volume[86811]: framework. For more detail see Sep 01 12:03:48 devstack cinder-volume[86811]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 12:03:48 devstack cinder-volume[86811]: import eventlet # noqa Sep 01 12:03:52 devstack cinder-volume[86811]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86811) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 12:03:52 devstack cinder-volume[86811]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86811) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 12:03:52 devstack cinder-volume[86811]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86811) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 12:03:52 devstack cinder-volume[86811]: INFO dbcounter [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] Registered counter for database cinder Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_db.sqlalchemy.engines [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86811) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG dbcounter [-] [86811] Writer thread running {{(pid=86811) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 12:03:53 devstack cinder-volume[86811]: INFO cinder.rpc [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 12:03:53 devstack cinder-volume[86811]: INFO cinder.rpc [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_db.sqlalchemy.engines [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86811) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 12:03:53 devstack cinder-volume[86811]: INFO cinder.volume.manager [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] Determined volume DB was empty at startup. Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG cinder.volume.manager [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86811) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 12:03:53 devstack cinder-volume[86811]: WARNING stevedore.named [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 12:03:53 devstack cinder-volume[86811]: WARNING castellan.key_manager [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 12:03:53 devstack cinder-volume[86811]: WARNING cinder.keymgr.conf_key_mgr [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 12:03:53 devstack cinder-volume[86811]: INFO cinder.volume.manager [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_db.sqlalchemy.engines [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86811) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 12:03:53 devstack cinder-volume[86811]: INFO oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] Starting 1 workers Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] Started child 87084 {{(pid=86811) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] Full set of CONF: {{(pid=86811) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] ******************************************************************************** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] Configuration options gathered from: {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] ================================================================================ {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] allow_availability_zone_fallback = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] allow_compression_on_image_upload = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] allowed_direct_url_schemes = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] api_rate_limit = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] auth_strategy = keystone {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_availability_zone = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_host = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_stats_polling_interval = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backup_api_class = cinder.backup.api.API {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backup_name_template = backup-%s {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backup_use_same_host = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backup_use_temp_snapshot = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] chap_password = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] chap_username = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cinder_internal_tenant_project_id = 46fc53ebbce643268f99df6d4ec1cb39 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cinder_internal_tenant_user_id = 9c73c27c81124f6b8c9a268bfb6fa066 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cluster = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] compression_format = gzip {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] compute_api_class = cinder.compute.nova.API {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] config_dir = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] config_source = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] control_exchange = openstack {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] debug = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] default_availability_zone = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] default_group_type = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] default_volume_type = QuobyteHD {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] disk_geometry = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] driver_client_cert = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] driver_client_cert_key = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] driver_data_namespace = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] driver_ssl_cert_path = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] driver_ssl_cert_verify = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[87084]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] driver_use_ssl = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] enable_new_services = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] enable_unsupported_driver = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] enabled_backends = ['QuobyteHD'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] enforce_multipath_for_image_xfer = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] filter_function = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance_api_insecure = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance_api_servers = ['http://192.168.122.29/image'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance_api_ssl_compression = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance_ca_certificates_file = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance_catalog_info = image:glance:publicURL {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance_certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance_keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance_num_retries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance_request_timeout = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] goodness_function = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] graceful_shutdown_timeout = 5 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] group_api_class = cinder.group.api.API {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] host = devstack {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] image_compress_on_upload = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] image_conversion_address_space_limit = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] image_conversion_cpu_limit = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] image_conversion_disable = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] image_upload_use_cinder_backend = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] image_upload_use_internal_tenant = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] image_volume_cache_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] image_volume_cache_max_count = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] image_volume_cache_max_size_gb = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] init_host_max_objects_retrieval = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] instance_format = [instance: %(uuid)s] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] iscsi_target_flags = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] iscsi_write_cache = on {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] iser_helper = tgtadm {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] iser_ip_address = 192.168.122.29 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] iser_port = 3260 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] log_color = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] log_config_append = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] log_dir = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] log_file = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] log_options = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] log_rotate_interval = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] log_rotate_interval_type = days {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] log_rotation_type = none {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] max_age = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] max_logfile_count = 30 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] max_logfile_size_mb = 200 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] max_over_subscription_ratio = 20.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] message_reap_interval = 86400 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] message_ttl = 2592000 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] migration_create_volume_timeout_secs = 300 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] monkey_patch = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] monkey_patch_modules = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] my_ip = 192.168.122.29 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] no_snapshot_gb_quota = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] num_iser_scan_tries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] num_shell_tries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] num_volume_device_scan_tries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] nvmeof_conn_info_version = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] nvmet_ns_id = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] nvmet_port_id = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] osapi_max_limit = 1000 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] osapi_volume_ext_list = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] osapi_volume_listen_port = 8776 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] osapi_volume_use_ssl = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] osapi_volume_workers = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87084) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] per_volume_size_limit = -1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] periodic_fuzzy_delay = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] periodic_interval = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] public_endpoint = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] publish_errors = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] quota_backup_gigabytes = 1000 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] quota_backups = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] quota_gigabytes = 1000 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] quota_groups = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] quota_snapshots = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] quota_volumes = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] rate_limit_burst = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] rate_limit_except_level = CRITICAL {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] rate_limit_interval = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] reinit_driver_count = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] replication_device = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] report_discard_supported = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] report_interval = 120 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] reservation_clean_interval = 86400 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] reservation_expire = 86400 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] reserved_image_namespaces = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] reserved_percentage = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] rpc_response_timeout = 120 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] run_external_periodic_tasks = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] scst_target_driver = iscsi {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] scst_target_iqn_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] service_down_time = 720 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] shell_completion = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] snapshot_name_template = snapshot-%s {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] split_loggers = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] state_path = /opt/stack/data/cinder {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] storage_availability_zone = nova {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] storage_protocol = iSCSI {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] syslog_log_facility = LOG_USER {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] target_helper = lioadm {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] target_ip_address = 192.168.122.29 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] target_port = 3260 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] target_protocol = iscsi {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] target_secondary_ip_addresses = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] trace_flags = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] transport_url = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] until_refresh = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] use_chap_auth = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] use_default_quota_class = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] use_journal = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] use_json = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] use_multipath_for_image_xfer = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] use_stderr = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] use_syslog = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] verify_glance_signatures = enabled {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] volume_api_class = cinder.volume.api.API {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] volume_backend_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] volume_clear = zero {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] volume_clear_ionice = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] volume_clear_size = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] volume_copy_bps_limit = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] volume_dd_blocksize = 1M {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] volume_name_template = volume-%s {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] volume_service_inithost_offload = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] volume_usage_audit_period = month {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] zoning_mode = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_concurrency.disable_process_locking = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.auth_section = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.auth_type = password {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.auth_version = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.cache = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.include_service_catalog = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.insecure = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.interface = public {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.memcache_password = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:53 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.memcache_username = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.region_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.service_type = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.29/identity {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.backend = dogpile.cache.null {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.backend_argument = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.backend_expiration_time = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.config_prefix = cache.oslo {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.debug_cache_backend = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.enable_retry_client = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.enable_socket_keepalive = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.expiration_time = 600 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.hashclient_retry_attempts = 2 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.memcache_dead_retry = 300 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.memcache_pool_maxsize = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.memcache_sasl_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.password = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.proxies = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.redis_db = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.redis_server = localhost:6379 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.retry_attempts = 2 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.retry_delay = 0.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.socket_keepalive_count = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.socket_keepalive_idle = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.socket_keepalive_interval = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.socket_timeout = 1.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.tls_allowed_ciphers = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.tls_cafile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87084) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 12:03:54 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.quobyte [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 12:03:54 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.quobyte [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.tls_certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.tls_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.tls_keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cache.username = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] coordination.backend_url = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.asyncio_connection = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Running cmd (subprocess): mount.quobyte {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.asyncio_slave_connection = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.backend = sqlalchemy {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.connection = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.connection_debug = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.connection_parameters = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.connection_recycle_time = 3600 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.connection_trace = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.db_inc_retry_interval = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.db_max_retries = 20 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.db_max_retry_interval = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.db_retry_interval = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.max_overflow = 50 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.max_pool_size = 5 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.max_retries = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.mysql_wsrep_sync_wait = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.pool_timeout = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.retry_interval = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.slave_connection = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.sqlite_synchronous = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.synchronous_reader = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] database.use_db_reconnect = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_tracing.insecure = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] profiler.connection_string = messaging:// {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] profiler.enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] profiler.es_doc_type = notification {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] profiler.es_scroll_size = 10000 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] profiler.es_scroll_time = 2m {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] profiler.filter_error_trace = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] profiler.hmac_keys = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] profiler.sentinel_service_name = mymaster {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] profiler.socket_timeout = 0.1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] profiler.trace_requests = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] profiler.trace_sqlalchemy = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] profiler_jaeger.process_tags = {} {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] profiler_jaeger.service_name_prefix = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] profiler_otlp.service_name_prefix = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_policy.enforce_new_defaults = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_policy.policy_default_rule = default {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_policy.policy_file = policy.yaml {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] privsep_osbrick.group = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] privsep_osbrick.helper_command = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] privsep_osbrick.user = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cinder_sys_admin.group = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cinder_sys_admin.helper_command = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] cinder_sys_admin.user = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] service_user.auth_section = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] service_user.auth_type = password {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] service_user.cafile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] service_user.certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] service_user.collect_timing = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] service_user.insecure = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] service_user.keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] service_user.send_service_user_token = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] service_user.split_loggers = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] service_user.timeout = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] service_user.tls_ciphers = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] service_user.tls_min_version = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance.auth_section = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance.auth_type = password {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance.certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance.collect_timing = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance.insecure = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance.keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance.region_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance.split_loggers = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance.timeout = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance.tls_ciphers = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] glance.tls_min_version = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.backend_availability_zone = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.chap_password = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.chap_username = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.disk_geometry = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.driver_client_cert = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.driver_client_cert_key = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.driver_data_namespace = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.driver_use_ssl = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.extra_capabilities = {} {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.filter_function = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.goodness_function = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.iscsi_target_flags = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.iscsi_write_cache = on {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.iser_helper = tgtadm {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.iser_ip_address = 192.168.122.29 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.iser_port = 3260 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.nas_host = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.nas_login = admin {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.nas_mount_options = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.nas_password = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.nas_private_key = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.nas_share_path = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.num_shell_tries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.quobyte_volume_url = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.replication_device = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.report_discard_supported = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.reserved_percentage = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.target_helper = tgtadm {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.target_ip_address = 192.168.122.29 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.target_port = 3260 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.target_protocol = iscsi {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.trace_flags = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.unique_fqdn_network = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.use_chap_auth = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.volume_backend_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.volume_clear = zero {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.volume_clear_ionice = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.volume_clear_size = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_reports.file_event_handler = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_reports.log_dir = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.backend_availability_zone = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.backend_host = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.chap_password = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.chap_username = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.chiscsi_conf = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.disk_geometry = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.driver_client_cert = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.driver_data_namespace = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.driver_use_ssl = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.extra_capabilities = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.filter_function = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.goodness_function = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.iser_helper = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.iser_ip_address = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.iser_port = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.iser_target_prefix = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.nas_host = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.nas_login = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.nas_mount_options = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.nas_password = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.nas_private_key = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.nas_share_path = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.nas_ssh_port = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.num_shell_tries = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.nvmet_port_id = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.replication_device = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.report_discard_supported = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.reserved_percentage = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.scst_target_driver = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.storage_protocol = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.target_helper = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.target_ip_address = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.target_port = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.target_prefix = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.target_protocol = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.trace_flags = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.use_chap_auth = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.volume_clear = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.volume_clear_size = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] QuobyteHD.volumes_dir = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack sudo[87091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.ssl = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_notifications.driver = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_notifications.retry = -1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] key_manager.fixed_key = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican.barbican_api_version = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican.barbican_endpoint = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican.barbican_endpoint_type = public {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican.barbican_region_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican.cafile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican.certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican.collect_timing = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican.insecure = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican.keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican.number_of_retries = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican.retry_delay = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican.send_service_user_token = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican.split_loggers = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican.timeout = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican.tls_ciphers = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican.tls_min_version = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican.verify_ssl = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican.verify_ssl_path = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican_service_user.auth_section = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican_service_user.auth_type = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican_service_user.cafile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican_service_user.certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican_service_user.collect_timing = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican_service_user.insecure = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican_service_user.keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican_service_user.split_loggers = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican_service_user.timeout = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican_service_user.tls_ciphers = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] barbican_service_user.tls_min_version = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] vault.approle_role_id = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] vault.approle_secret_id = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] vault.auth_method = approle {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] vault.auth_path = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] vault.kv_mountpoint = secret {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] vault.kv_path = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] vault.kv_version = 2 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] vault.namespace = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] vault.root_token_id = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] vault.ssl_ca_crt_file = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] vault.timeout = 60.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] vault.token_file = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] vault.token_role = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] vault.use_ssl = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:03:54 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-3b314f5d-fea4-482a-bfe2-d37c4d98a8b3 None None] ******************************************************************************** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 12:03:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] CMD "mount.quobyte" returned: 1 in 0.186s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:03:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:03:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:03:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:03:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:03:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:03:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:03:54 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root Sep 01 12:03:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.502s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:03:54 devstack cinder-volume[87084]: INFO cinder.volume.driver [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Driver hasn't implemented _init_vendor_properties() Sep 01 12:03:54 devstack cinder-volume[87084]: DEBUG cinder.volume.driver [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9639739990234, 'free_capacity_gb': 1773.9639739990234, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87084) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 12:03:54 devstack cinder-volume[87084]: DEBUG oslo_db.sqlalchemy.engines [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87084) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 12:03:54 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writer thread running {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 12:03:54 devstack cinder-volume[87084]: DEBUG cinder.db.api [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Building query based on filter {{(pid=87084) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 12:03:54 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87084) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 12:03:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:03:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:03:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:03:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:03:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:03:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:03:54 devstack cinder-volume[87084]: INFO cinder.keymgr.migration [None req-8e28b005-90d8-4738-bc52-b757447a7848 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 12:03:54 devstack sudo[87104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:03:54 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:03:55 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root Sep 01 12:03:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.299s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:03:55 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:03:55 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Driver initialization completed successfully. Sep 01 12:03:55 devstack cinder-volume[87084]: INFO cinder.manager [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Initiating service 3 cleanup Sep 01 12:03:55 devstack cinder-volume[87084]: INFO cinder.manager [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Service 3 cleanup completed. Sep 01 12:03:55 devstack cinder-volume[87084]: DEBUG cinder.service [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Creating RPC server for service cinder-volume {{(pid=87084) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 12:03:55 devstack cinder-volume[87084]: DEBUG cinder.service [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87084) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 12:03:55 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 12:03:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:03:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:03:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:03:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:03:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:03:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:03:55 devstack sudo[87118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:03:55 devstack sudo[87118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:03:55 devstack sudo[87118]: pam_unix(sudo:session): session closed for user root Sep 01 12:03:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.304s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:03:55 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8408951f-3914-4e20-bd50-7f8b5b4d558a None None] Driver post RPC initialization completed successfully. Sep 01 12:04:03 devstack cinder-volume[86811]: DEBUG dbcounter [-] [86811] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86811) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:04:04 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:04:05 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:04:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:04:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 6 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:04:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:05:10 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:05:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Flow 'volume_create_manager' (c4388737-2b54-4466-b064-0655cc1fb503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:05:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edac61b3-8cac-43c6-a722-eab25ac26a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edac61b3-8cac-43c6-a722-eab25ac26a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1847977246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122a67f0-3880-48c3-a3c7-c8e83fee36ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7766745bd7bd4c929b7067d7e1d811f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:05:10Z,use_quota=True,user_id='12055209abb04fb4a0702f909bd4724b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6b7636-bae3-4743-9c0a-8dd904308a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6b7636-bae3-4743-9c0a-8dd904308a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (055d2525-c09f-4281-8ff9-b1fdc54cad3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (055d2525-c09f-4281-8ff9-b1fdc54cad3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '122a67f0-3880-48c3-a3c7-c8e83fee36ab', 'volume_name': 'volume-122a67f0-3880-48c3-a3c7-c8e83fee36ab', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f83e59e-07f1-4b28-8a43-7c4705d5da6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f83e59e-07f1-4b28-8a43-7c4705d5da6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aeb2a46-cc82-4f2f-8fa3-40b1646047c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:11 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Volume 122a67f0-3880-48c3-a3c7-c8e83fee36ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-122a67f0-3880-48c3-a3c7-c8e83fee36ab', 'volume_size': 1} Sep 01 12:05:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:05:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:05:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1847977246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122a67f0-3880-48c3-a3c7-c8e83fee36ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7766745bd7bd4c929b7067d7e1d811f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:05:10Z,use_quota=True,user_id='12055209abb04fb4a0702f909bd4724b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:05:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Creating volume 122a67f0-3880-48c3-a3c7-c8e83fee36ab {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:05:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:05:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:05:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:05:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:05:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:05:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:05:11 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:05:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-122a67f0-3880-48c3-a3c7-c8e83fee36ab 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:11 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-122a67f0-3880-48c3-a3c7-c8e83fee36ab 1073741824 Sep 01 12:05:11 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:13 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-122a67f0-3880-48c3-a3c7-c8e83fee36ab 1073741824" returned: 0 in 1.996s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-122a67f0-3880-48c3-a3c7-c8e83fee36ab {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:13 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-122a67f0-3880-48c3-a3c7-c8e83fee36ab Sep 01 12:05:13 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:14 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-122a67f0-3880-48c3-a3c7-c8e83fee36ab" returned: 0 in 0.833s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] <== create_volume: return (3033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:05:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.044s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:05:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aeb2a46-cc82-4f2f-8fa3-40b1646047c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-122a67f0-3880-48c3-a3c7-c8e83fee36ab', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2af8fc-8adb-4186-bb83-91c791b09f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:14 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Volume volume-122a67f0-3880-48c3-a3c7-c8e83fee36ab (122a67f0-3880-48c3-a3c7-c8e83fee36ab): created successfully Sep 01 12:05:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2af8fc-8adb-4186-bb83-91c791b09f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Flow 'volume_create_manager' (c4388737-2b54-4466-b064-0655cc1fb503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:05:14 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e0edd559-4ebe-4dff-b2c1-2cd7eb9a659d tempest-DeleteServersTestJSON-163611049 None] Created volume successfully. Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Flow 'volume_create_manager' (6ea6451d-f871-4808-97f2-215cf32ae12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd2f190-a054-4a83-a921-eb6d77e33753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd2f190-a054-4a83-a921-eb6d77e33753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-45925853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0fd882-aca9-4de0-b84c-88cbbc154aa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f19fa8311dc49c5a70e913c4ffb3766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:05:19Z,use_quota=True,user_id='af46f7978b0f4f3aa715fccfc47a720f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (891cadba-d028-4eb4-b1d1-0e54b076650b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (891cadba-d028-4eb4-b1d1-0e54b076650b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f1bf6f2-5ab6-4783-92e3-20b789327d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f1bf6f2-5ab6-4783-92e3-20b789327d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc0fd882-aca9-4de0-b84c-88cbbc154aa0', 'volume_name': 'volume-dc0fd882-aca9-4de0-b84c-88cbbc154aa0', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e461cb-ecbd-4af4-a092-1731ac85773f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e461cb-ecbd-4af4-a092-1731ac85773f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70809c4a-9850-4f3b-9d4f-5565005e6570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:19 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Volume dc0fd882-aca9-4de0-b84c-88cbbc154aa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc0fd882-aca9-4de0-b84c-88cbbc154aa0', 'volume_size': 1} Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-45925853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0fd882-aca9-4de0-b84c-88cbbc154aa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f19fa8311dc49c5a70e913c4ffb3766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:05:19Z,use_quota=True,user_id='af46f7978b0f4f3aa715fccfc47a720f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Creating volume dc0fd882-aca9-4de0-b84c-88cbbc154aa0 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:05:19 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:05:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-dc0fd882-aca9-4de0-b84c-88cbbc154aa0 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:19 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-dc0fd882-aca9-4de0-b84c-88cbbc154aa0 1073741824 Sep 01 12:05:19 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:20 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-dc0fd882-aca9-4de0-b84c-88cbbc154aa0 1073741824" returned: 0 in 1.341s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-dc0fd882-aca9-4de0-b84c-88cbbc154aa0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:21 devstack sudo[88395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-dc0fd882-aca9-4de0-b84c-88cbbc154aa0 Sep 01 12:05:21 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:21 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-dc0fd882-aca9-4de0-b84c-88cbbc154aa0" returned: 0 in 0.868s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] <== create_volume: return (2394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:05:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.406s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:05:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70809c4a-9850-4f3b-9d4f-5565005e6570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc0fd882-aca9-4de0-b84c-88cbbc154aa0', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f832c479-cc6c-4b9c-a60c-e626e70f6bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:21 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Volume volume-dc0fd882-aca9-4de0-b84c-88cbbc154aa0 (dc0fd882-aca9-4de0-b84c-88cbbc154aa0): created successfully Sep 01 12:05:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f832c479-cc6c-4b9c-a60c-e626e70f6bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Flow 'volume_create_manager' (6ea6451d-f871-4808-97f2-215cf32ae12e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:05:22 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a9ecbce7-5e03-422b-a79b-db736d8b5cb6 tempest-VolumesAdminNegativeTest-1820133411 None] Created volume successfully. Sep 01 12:05:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Acquiring lock "cinder-dc0fd882-aca9-4de0-b84c-88cbbc154aa0-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:05:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Lock "cinder-dc0fd882-aca9-4de0-b84c-88cbbc154aa0-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:05:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Acquiring lock "cinder-quobyte-dc0fd882-aca9-4de0-b84c-88cbbc154aa0" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:05:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Lock "cinder-quobyte-dc0fd882-aca9-4de0-b84c-88cbbc154aa0" acquired by "delete_volume" :: waited 0.067s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:05:23 devstack cinder-volume[87084]: INFO oslo.privsep.daemon [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9o4vyi58/privsep.sock'] Sep 01 12:05:23 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9o4vyi58/privsep.sock Sep 01 12:05:23 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:24 devstack cinder-volume[87084]: WARNING py.warnings [req-dea1433d-152a-4ae9-ade3-d79f1f17ef60 req-8045d25c-6b82-4631-b7e4-c2ef01d20105 tempest-DeleteServersTestJSON-163611049 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 01 12:05:24 devstack cinder-volume[87084]: .first() Sep 01 12:05:24 devstack cinder-volume[87084]: Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-dea1433d-152a-4ae9-ade3-d79f1f17ef60 req-8045d25c-6b82-4631-b7e4-c2ef01d20105 tempest-DeleteServersTestJSON-163611049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-dea1433d-152a-4ae9-ade3-d79f1f17ef60 req-8045d25c-6b82-4631-b7e4-c2ef01d20105 tempest-DeleteServersTestJSON-163611049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-dea1433d-152a-4ae9-ade3-d79f1f17ef60 req-8045d25c-6b82-4631-b7e4-c2ef01d20105 tempest-DeleteServersTestJSON-163611049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Flow 'volume_create_manager' (197b0313-5463-49a9-aa16-17ed02c67b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcffb854-27d1-4cd7-8c83-1d6476c17ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcffb854-27d1-4cd7-8c83-1d6476c17ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1428065595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2267ef28-20aa-44ef-a13b-8ebccf5b0f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d18fae815c489a9cfeb16f164e5cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:05:24Z,use_quota=True,user_id='35a5d2afab30492785d4b159044d2c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e46f55c-f673-4e8b-8506-4b8cd78e11f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e46f55c-f673-4e8b-8506-4b8cd78e11f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c030dd75-7c89-4b49-9085-c5abecadd89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c030dd75-7c89-4b49-9085-c5abecadd89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2267ef28-20aa-44ef-a13b-8ebccf5b0f6a', 'volume_name': 'volume-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7443441d-6c40-498e-878f-da96a32192b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7443441d-6c40-498e-878f-da96a32192b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566a255a-71cf-4bf3-88d5-0fa6e357ee31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:24 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Volume 2267ef28-20aa-44ef-a13b-8ebccf5b0f6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a', 'volume_size': 1} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1428065595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2267ef28-20aa-44ef-a13b-8ebccf5b0f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d18fae815c489a9cfeb16f164e5cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:05:24Z,use_quota=True,user_id='35a5d2afab30492785d4b159044d2c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Creating volume 2267ef28-20aa-44ef-a13b-8ebccf5b0f6a {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:05:24 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-dea1433d-152a-4ae9-ade3-d79f1f17ef60 req-8045d25c-6b82-4631-b7e4-c2ef01d20105 tempest-DeleteServersTestJSON-163611049 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-122a67f0-3880-48c3-a3c7-c8e83fee36ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbf68c51-7459-4b93-9297-de16c16a2aa0', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:05:24 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a 1073741824 Sep 01 12:05:24 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:25 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-dea1433d-152a-4ae9-ade3-d79f1f17ef60 req-8045d25c-6b82-4631-b7e4-c2ef01d20105 tempest-DeleteServersTestJSON-163611049 None] attachment_update completed successfully. Sep 01 12:05:25 devstack cinder-volume[87084]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 01 12:05:25 devstack cinder-volume[87084]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 12:05:25 devstack cinder-volume[87084]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 01 12:05:25 devstack cinder-volume[87084]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 12:05:25 devstack cinder-volume[87084]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 01 12:05:25 devstack cinder-volume[87084]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 01 12:05:25 devstack cinder-volume[87084]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 12:05:25 devstack cinder-volume[87084]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 12:05:25 devstack cinder-volume[87084]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 01 12:05:25 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:25 devstack cinder-volume[87084]: INFO oslo.privsep.daemon [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Spawned new privsep daemon via rootwrap Sep 01 12:05:25 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Accepted privsep connection to /tmp/tmp9o4vyi58/privsep.sock {{(pid=87084) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 01 12:05:25 devstack cinder-volume[87084]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 01 12:05:25 devstack cinder-volume[87084]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 01 12:05:25 devstack cinder-volume[87084]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 01 12:05:25 devstack cinder-volume[87084]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88419 Sep 01 12:05:25 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aac8ab8-fe51-47be-adbe-5c38dc37ecf9]: (2,) {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:05:26 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[edebfa48-ccf6-4a1b-b23d-0a5e1746e2ca]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:05:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-dc0fd882-aca9-4de0-b84c-88cbbc154aa0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:26 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a 1073741824" returned: 0 in 1.162s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:26 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a Sep 01 12:05:26 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:26 devstack sudo[88454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-dc0fd882-aca9-4de0-b84c-88cbbc154aa0 Sep 01 12:05:26 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:27 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a" returned: 0 in 1.013s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] <== create_volume: return (2315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:05:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.318s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:05:27 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566a255a-71cf-4bf3-88d5-0fa6e357ee31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:27 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ca0f12-3088-43f3-9ab2-a026109b5e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:27 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Volume volume-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a (2267ef28-20aa-44ef-a13b-8ebccf5b0f6a): created successfully Sep 01 12:05:27 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ca0f12-3088-43f3-9ab2-a026109b5e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:27 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Flow 'volume_create_manager' (197b0313-5463-49a9-aa16-17ed02c67b30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:05:27 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9289e617-263d-4c17-99e1-bf9bc42f08ae tempest-ServerRescueNegativeTestJSON-1085312846 None] Created volume successfully. Sep 01 12:05:27 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-dc0fd882-aca9-4de0-b84c-88cbbc154aa0" returned: 0 in 1.482s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-dc0fd882-aca9-4de0-b84c-88cbbc154aa0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:27 devstack sudo[88840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-dc0fd882-aca9-4de0-b84c-88cbbc154aa0 Sep 01 12:05:27 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:28 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-dc0fd882-aca9-4de0-b84c-88cbbc154aa0" returned: 0 in 0.697s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Lock "cinder-quobyte-dc0fd882-aca9-4de0-b84c-88cbbc154aa0" released by "delete_volume" :: held 4.589s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:05:28 devstack cinder-volume[87084]: WARNING cinder.quota [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:05:28 devstack cinder-volume[87084]: WARNING cinder.quota [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:05:28 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Created reservations ['3151535a-105e-49c1-b6e7-3757965ee216', 'bf9b618b-a7e7-4621-abcb-7eb7ec973ba0', '178d6366-c385-48f1-88b9-761a42e51f6f', 'cdc0f745-a2b4-4bbe-bf0f-56aaae651ab7'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:05:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:05:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:05:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:05:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:05:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:05:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:28 devstack sudo[88873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:05:28 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:29 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.637s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:29 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:05:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Deleted volume successfully. Sep 01 12:05:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c4a3402e-0865-48ac-8fe2-422871f040a3 tempest-VolumesAdminNegativeTest-1820133411 None] Lock "cinder-dc0fd882-aca9-4de0-b84c-88cbbc154aa0-delete_volume" released by "delete_volume" :: held 6.149s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:05:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-40e4ffeb-3cff-4e28-b2b9-9061dc80c79b req-a0167973-e610-4dfa-ad21-6d9acbe34cfe tempest-DeleteServersTestJSON-163611049 None] Terminate volume connection completed successfully. Sep 01 12:05:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-40e4ffeb-3cff-4e28-b2b9-9061dc80c79b req-a0167973-e610-4dfa-ad21-6d9acbe34cfe tempest-DeleteServersTestJSON-163611049 None] Deleting attachment bbf68c51-7459-4b93-9297-de16c16a2aa0. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:05:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-844becf7-3b82-4801-ab78-c02047ad6bd9 tempest-DeleteServersTestJSON-163611049 None] Acquiring lock "cinder-122a67f0-3880-48c3-a3c7-c8e83fee36ab-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:05:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-844becf7-3b82-4801-ab78-c02047ad6bd9 tempest-DeleteServersTestJSON-163611049 None] Lock "cinder-122a67f0-3880-48c3-a3c7-c8e83fee36ab-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:05:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-844becf7-3b82-4801-ab78-c02047ad6bd9 tempest-DeleteServersTestJSON-163611049 None] Acquiring lock "cinder-quobyte-122a67f0-3880-48c3-a3c7-c8e83fee36ab" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:05:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-844becf7-3b82-4801-ab78-c02047ad6bd9 tempest-DeleteServersTestJSON-163611049 None] Lock "cinder-quobyte-122a67f0-3880-48c3-a3c7-c8e83fee36ab" acquired by "delete_volume" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:05:36 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bb5636-c797-4ab3-8fa6-e3f311889610]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:05:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-844becf7-3b82-4801-ab78-c02047ad6bd9 tempest-DeleteServersTestJSON-163611049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-122a67f0-3880-48c3-a3c7-c8e83fee36ab {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:36 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-122a67f0-3880-48c3-a3c7-c8e83fee36ab Sep 01 12:05:36 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:37 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-844becf7-3b82-4801-ab78-c02047ad6bd9 tempest-DeleteServersTestJSON-163611049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-122a67f0-3880-48c3-a3c7-c8e83fee36ab" returned: 0 in 0.687s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-844becf7-3b82-4801-ab78-c02047ad6bd9 tempest-DeleteServersTestJSON-163611049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-122a67f0-3880-48c3-a3c7-c8e83fee36ab {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:37 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-122a67f0-3880-48c3-a3c7-c8e83fee36ab Sep 01 12:05:37 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:37 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-844becf7-3b82-4801-ab78-c02047ad6bd9 tempest-DeleteServersTestJSON-163611049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-122a67f0-3880-48c3-a3c7-c8e83fee36ab" returned: 0 in 0.430s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-844becf7-3b82-4801-ab78-c02047ad6bd9 tempest-DeleteServersTestJSON-163611049 None] Lock "cinder-quobyte-122a67f0-3880-48c3-a3c7-c8e83fee36ab" released by "delete_volume" :: held 1.179s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:05:37 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-844becf7-3b82-4801-ab78-c02047ad6bd9 tempest-DeleteServersTestJSON-163611049 None] Created reservations ['8f1127a4-64b3-436e-a77d-219bdf56e747', '4c3c42da-254c-49c2-b453-a51d11f5e5e6', '34befee9-c115-417e-bd92-133bed4a446b', 'a6082108-7147-4441-9726-98b0b6f8951b'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:05:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-844becf7-3b82-4801-ab78-c02047ad6bd9 tempest-DeleteServersTestJSON-163611049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:05:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-844becf7-3b82-4801-ab78-c02047ad6bd9 tempest-DeleteServersTestJSON-163611049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:05:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-844becf7-3b82-4801-ab78-c02047ad6bd9 tempest-DeleteServersTestJSON-163611049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:05:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-844becf7-3b82-4801-ab78-c02047ad6bd9 tempest-DeleteServersTestJSON-163611049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:05:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-844becf7-3b82-4801-ab78-c02047ad6bd9 tempest-DeleteServersTestJSON-163611049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:05:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-844becf7-3b82-4801-ab78-c02047ad6bd9 tempest-DeleteServersTestJSON-163611049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:38 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:05:38 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:38 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-844becf7-3b82-4801-ab78-c02047ad6bd9 tempest-DeleteServersTestJSON-163611049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.542s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:38 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-844becf7-3b82-4801-ab78-c02047ad6bd9 tempest-DeleteServersTestJSON-163611049 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:05:38 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-844becf7-3b82-4801-ab78-c02047ad6bd9 tempest-DeleteServersTestJSON-163611049 None] Deleted volume successfully. Sep 01 12:05:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-844becf7-3b82-4801-ab78-c02047ad6bd9 tempest-DeleteServersTestJSON-163611049 None] Lock "cinder-122a67f0-3880-48c3-a3c7-c8e83fee36ab-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:05:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:05:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:05:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:05:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:05:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:05:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:05:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:41 devstack sudo[89038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:05:41 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:42 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.291s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:05:42 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:05:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 8 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:05:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:05:48 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=24,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:05:48 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=23,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Flow 'volume_create_manager' (2b51c28e-590b-4636-b653-3e01e9fa604b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faca4560-8262-41ce-8b80-6cb93cf92550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faca4560-8262-41ce-8b80-6cb93cf92550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1314970863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0924405f-934f-490f-a48e-0964a573984c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e07c66c936c4554b23a7354998faaf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:05:50Z,use_quota=True,user_id='23176802f7764a7ea7cd6514b5ec56a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91bd858d-b2a3-49ce-972e-8d2e50121537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91bd858d-b2a3-49ce-972e-8d2e50121537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6292044e-5b34-45ef-9062-d18e60ab81a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6292044e-5b34-45ef-9062-d18e60ab81a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0924405f-934f-490f-a48e-0964a573984c', 'volume_name': 'volume-0924405f-934f-490f-a48e-0964a573984c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c52ce21-4af2-44b0-a43d-f38bd7693ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c52ce21-4af2-44b0-a43d-f38bd7693ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa0b3030-9b57-40c4-b348-46e96367c35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:50 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Volume 0924405f-934f-490f-a48e-0964a573984c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0924405f-934f-490f-a48e-0964a573984c', 'volume_size': 1} Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1314970863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0924405f-934f-490f-a48e-0964a573984c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e07c66c936c4554b23a7354998faaf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:05:50Z,use_quota=True,user_id='23176802f7764a7ea7cd6514b5ec56a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Creating volume 0924405f-934f-490f-a48e-0964a573984c {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:05:50 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:05:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:50 devstack sudo[89079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c 1073741824 Sep 01 12:05:50 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:51 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c 1073741824" returned: 0 in 0.573s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:51 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c Sep 01 12:05:51 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:51 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c" returned: 0 in 0.283s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:05:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:05:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa0b3030-9b57-40c4-b348-46e96367c35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0924405f-934f-490f-a48e-0964a573984c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05baf88a-8b0d-44dc-b35a-cfe3e9891e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:05:51 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Volume volume-0924405f-934f-490f-a48e-0964a573984c (0924405f-934f-490f-a48e-0964a573984c): created successfully Sep 01 12:05:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05baf88a-8b0d-44dc-b35a-cfe3e9891e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:05:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Flow 'volume_create_manager' (2b51c28e-590b-4636-b653-3e01e9fa604b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:05:51 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-99037699-d157-415a-87e8-4fffc8d273b0 req-0f70d98d-b73a-49a0-84ca-d4cdebd3f9c9 tempest-VolumesSnapshotsTestJSON-1182837741 None] Created volume successfully. Sep 01 12:05:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-510965f0-0423-4402-a807-9fa3401e6be6 tempest-ServerRescueNegativeTestJSON-1085312846 None] Acquiring lock "cinder-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:05:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-510965f0-0423-4402-a807-9fa3401e6be6 tempest-ServerRescueNegativeTestJSON-1085312846 None] Lock "cinder-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:05:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-510965f0-0423-4402-a807-9fa3401e6be6 tempest-ServerRescueNegativeTestJSON-1085312846 None] Acquiring lock "cinder-quobyte-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:05:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-510965f0-0423-4402-a807-9fa3401e6be6 tempest-ServerRescueNegativeTestJSON-1085312846 None] Lock "cinder-quobyte-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:05:52 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3f48e0-69a4-4558-ac61-294c79281497]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:05:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-510965f0-0423-4402-a807-9fa3401e6be6 tempest-ServerRescueNegativeTestJSON-1085312846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:52 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a Sep 01 12:05:52 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:52 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-510965f0-0423-4402-a807-9fa3401e6be6 tempest-ServerRescueNegativeTestJSON-1085312846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a" returned: 0 in 0.550s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-510965f0-0423-4402-a807-9fa3401e6be6 tempest-ServerRescueNegativeTestJSON-1085312846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:52 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a Sep 01 12:05:52 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-b907978b-4e19-4b3e-a027-c7e5f4ed37ec req-1b75d511-95c7-4de6-9607-301614a86e6f tempest-VolumesSnapshotsTestJSON-1182837741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:05:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-b907978b-4e19-4b3e-a027-c7e5f4ed37ec req-1b75d511-95c7-4de6-9607-301614a86e6f tempest-VolumesSnapshotsTestJSON-1182837741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:05:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [req-b907978b-4e19-4b3e-a027-c7e5f4ed37ec req-1b75d511-95c7-4de6-9607-301614a86e6f tempest-VolumesSnapshotsTestJSON-1182837741 None] Creating offline snapshot a032823e-0b46-4c28-b31c-72052fde0721 of volume 0924405f-934f-490f-a48e-0964a573984c {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:05:53 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bec8d2a-9201-42dc-9b78-25165d68dc7a]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:05:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b907978b-4e19-4b3e-a027-c7e5f4ed37ec req-1b75d511-95c7-4de6-9607-301614a86e6f tempest-VolumesSnapshotsTestJSON-1182837741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:53 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-510965f0-0423-4402-a807-9fa3401e6be6 tempest-ServerRescueNegativeTestJSON-1085312846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a" returned: 0 in 0.697s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-510965f0-0423-4402-a807-9fa3401e6be6 tempest-ServerRescueNegativeTestJSON-1085312846 None] Lock "cinder-quobyte-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a" released by "delete_volume" :: held 1.340s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:05:53 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c Sep 01 12:05:53 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:53 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-510965f0-0423-4402-a807-9fa3401e6be6 tempest-ServerRescueNegativeTestJSON-1085312846 None] Created reservations ['4ddce637-b89e-4049-be1f-768db484c54f', 'd8cbbd1e-7430-4f03-adbc-263948e0d221', '78453637-e4bf-4d06-a882-c36f63d17f6f', '9e0b8ea3-4367-4a26-8fd1-7baf7e9b4215'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:05:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-510965f0-0423-4402-a807-9fa3401e6be6 tempest-ServerRescueNegativeTestJSON-1085312846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:05:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-510965f0-0423-4402-a807-9fa3401e6be6 tempest-ServerRescueNegativeTestJSON-1085312846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:05:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-510965f0-0423-4402-a807-9fa3401e6be6 tempest-ServerRescueNegativeTestJSON-1085312846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:05:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-510965f0-0423-4402-a807-9fa3401e6be6 tempest-ServerRescueNegativeTestJSON-1085312846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:05:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-510965f0-0423-4402-a807-9fa3401e6be6 tempest-ServerRescueNegativeTestJSON-1085312846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:05:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-510965f0-0423-4402-a807-9fa3401e6be6 tempest-ServerRescueNegativeTestJSON-1085312846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:54 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:05:54 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:54 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b907978b-4e19-4b3e-a027-c7e5f4ed37ec req-1b75d511-95c7-4de6-9607-301614a86e6f tempest-VolumesSnapshotsTestJSON-1182837741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c" returned: 0 in 0.740s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b907978b-4e19-4b3e-a027-c7e5f4ed37ec req-1b75d511-95c7-4de6-9607-301614a86e6f tempest-VolumesSnapshotsTestJSON-1182837741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.a032823e-0b46-4c28-b31c-72052fde0721 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:54 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.a032823e-0b46-4c28-b31c-72052fde0721 1G Sep 01 12:05:54 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:54 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-510965f0-0423-4402-a807-9fa3401e6be6 tempest-ServerRescueNegativeTestJSON-1085312846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.605s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:54 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-510965f0-0423-4402-a807-9fa3401e6be6 tempest-ServerRescueNegativeTestJSON-1085312846 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:05:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-510965f0-0423-4402-a807-9fa3401e6be6 tempest-ServerRescueNegativeTestJSON-1085312846 None] Deleted volume successfully. Sep 01 12:05:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-510965f0-0423-4402-a807-9fa3401e6be6 tempest-ServerRescueNegativeTestJSON-1085312846 None] Lock "cinder-2267ef28-20aa-44ef-a13b-8ebccf5b0f6a-delete_volume" released by "delete_volume" :: held 2.622s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:05:55 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b907978b-4e19-4b3e-a027-c7e5f4ed37ec req-1b75d511-95c7-4de6-9607-301614a86e6f tempest-VolumesSnapshotsTestJSON-1182837741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.a032823e-0b46-4c28-b31c-72052fde0721 1G" returned: 0 in 0.966s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b907978b-4e19-4b3e-a027-c7e5f4ed37ec req-1b75d511-95c7-4de6-9607-301614a86e6f tempest-VolumesSnapshotsTestJSON-1182837741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0924405f-934f-490f-a48e-0964a573984c -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.a032823e-0b46-4c28-b31c-72052fde0721 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:55 devstack sudo[89135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0924405f-934f-490f-a48e-0964a573984c -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.a032823e-0b46-4c28-b31c-72052fde0721 Sep 01 12:05:55 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:55 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b907978b-4e19-4b3e-a027-c7e5f4ed37ec req-1b75d511-95c7-4de6-9607-301614a86e6f tempest-VolumesSnapshotsTestJSON-1182837741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0924405f-934f-490f-a48e-0964a573984c -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.a032823e-0b46-4c28-b31c-72052fde0721" returned: 0 in 0.704s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:55 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [req-b907978b-4e19-4b3e-a027-c7e5f4ed37ec req-1b75d511-95c7-4de6-9607-301614a86e6f tempest-VolumesSnapshotsTestJSON-1182837741 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.a032823e-0b46-4c28-b31c-72052fde0721 is being set with open permissions: ugo+rw Sep 01 12:05:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b907978b-4e19-4b3e-a027-c7e5f4ed37ec req-1b75d511-95c7-4de6-9607-301614a86e6f tempest-VolumesSnapshotsTestJSON-1182837741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.a032823e-0b46-4c28-b31c-72052fde0721 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:55 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.a032823e-0b46-4c28-b31c-72052fde0721 Sep 01 12:05:55 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:56 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b907978b-4e19-4b3e-a027-c7e5f4ed37ec req-1b75d511-95c7-4de6-9607-301614a86e6f tempest-VolumesSnapshotsTestJSON-1182837741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.a032823e-0b46-4c28-b31c-72052fde0721" returned: 0 in 0.407s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b907978b-4e19-4b3e-a027-c7e5f4ed37ec req-1b75d511-95c7-4de6-9607-301614a86e6f tempest-VolumesSnapshotsTestJSON-1182837741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:56 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.info Sep 01 12:05:56 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:56 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b907978b-4e19-4b3e-a027-c7e5f4ed37ec req-1b75d511-95c7-4de6-9607-301614a86e6f tempest-VolumesSnapshotsTestJSON-1182837741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.info" returned: 0 in 0.391s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:56 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [req-b907978b-4e19-4b3e-a027-c7e5f4ed37ec req-1b75d511-95c7-4de6-9607-301614a86e6f tempest-VolumesSnapshotsTestJSON-1182837741 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.info is being set with open permissions: ugo+rw Sep 01 12:05:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b907978b-4e19-4b3e-a027-c7e5f4ed37ec req-1b75d511-95c7-4de6-9607-301614a86e6f tempest-VolumesSnapshotsTestJSON-1182837741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:56 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.info Sep 01 12:05:56 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:57 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b907978b-4e19-4b3e-a027-c7e5f4ed37ec req-1b75d511-95c7-4de6-9607-301614a86e6f tempest-VolumesSnapshotsTestJSON-1182837741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.info" returned: 0 in 0.474s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-b907978b-4e19-4b3e-a027-c7e5f4ed37ec req-1b75d511-95c7-4de6-9607-301614a86e6f tempest-VolumesSnapshotsTestJSON-1182837741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.877s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:05:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-b907978b-4e19-4b3e-a027-c7e5f4ed37ec req-1b75d511-95c7-4de6-9607-301614a86e6f tempest-VolumesSnapshotsTestJSON-1182837741 None] Create snapshot completed successfully Sep 01 12:05:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] Acquiring lock "cinder-a032823e-0b46-4c28-b31c-72052fde0721-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:05:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] Lock "cinder-a032823e-0b46-4c28-b31c-72052fde0721-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:05:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] Acquiring lock "cinder-quobyte-0924405f-934f-490f-a48e-0964a573984c" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:05:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] Lock "cinder-quobyte-0924405f-934f-490f-a48e-0964a573984c" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:05:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] Acquiring lock "cinder-quobyte-a032823e-0b46-4c28-b31c-72052fde0721" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:05:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] Lock "cinder-quobyte-a032823e-0b46-4c28-b31c-72052fde0721" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:05:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] Deleting offline snapshot a032823e-0b46-4c28-b31c-72052fde0721 of volume 0924405f-934f-490f-a48e-0964a573984c {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:05:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] snapshot_file for this snap is: volume-0924405f-934f-490f-a48e-0964a573984c.a032823e-0b46-4c28-b31c-72052fde0721 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:05:58 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b398e11-619f-4be6-809a-6445a2934250]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:05:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.a032823e-0b46-4c28-b31c-72052fde0721 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:58 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.a032823e-0b46-4c28-b31c-72052fde0721 Sep 01 12:05:58 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:58 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.a032823e-0b46-4c28-b31c-72052fde0721" returned: 0 in 0.570s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0924405f-934f-490f-a48e-0964a573984c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:05:58 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cbdae5-500f-4bde-af17-cd397c06c049]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:05:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:59 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c Sep 01 12:05:59 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:05:59 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Sep 01 12:05:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c" returned: 0 in 0.603s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:05:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.a032823e-0b46-4c28-b31c-72052fde0721 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:05:59 devstack sudo[89191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.a032823e-0b46-4c28-b31c-72052fde0721 Sep 01 12:05:59 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:00 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.a032823e-0b46-4c28-b31c-72052fde0721" returned: 0 in 0.530s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.a032823e-0b46-4c28-b31c-72052fde0721 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:00 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.a032823e-0b46-4c28-b31c-72052fde0721 Sep 01 12:06:00 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:00 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c.a032823e-0b46-4c28-b31c-72052fde0721" returned: 0 in 0.664s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] Lock "cinder-quobyte-a032823e-0b46-4c28-b31c-72052fde0721" released by "_delete_snapshot" :: held 2.504s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:06:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] Lock "cinder-quobyte-0924405f-934f-490f-a48e-0964a573984c" released by "delete_snapshot" :: held 2.547s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:06:00 devstack cinder-volume[87084]: WARNING cinder.quota [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:06:00 devstack cinder-volume[87084]: DEBUG cinder.quota [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] Created reservations ['9d264d16-3fb2-4639-877e-6708d052e122', 'f71b88d1-23f6-47a9-a48f-8546ce3fce34', '0b23ac10-9775-487e-9259-c09487daffa1', '182c2b3a-45a1-4a3e-addf-1163e01d3317'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:06:01 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] Delete snapshot completed successfully. Sep 01 12:06:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-ce878cfc-eebd-486c-aebc-89500d25e2aa req-c28dcd87-6c9d-4be7-866e-ff81ffbca39a tempest-VolumesSnapshotsTestJSON-1182837741 None] Lock "cinder-a032823e-0b46-4c28-b31c-72052fde0721-delete_snapshot" released by "delete_snapshot" :: held 2.801s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:06:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-ec577b35-c49e-4a3c-a10f-910d8695b044 req-76d5d1c6-4368-4b10-ad9c-849794615a80 tempest-VolumesSnapshotsTestJSON-1182837741 None] Acquiring lock "cinder-0924405f-934f-490f-a48e-0964a573984c-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:06:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-ec577b35-c49e-4a3c-a10f-910d8695b044 req-76d5d1c6-4368-4b10-ad9c-849794615a80 tempest-VolumesSnapshotsTestJSON-1182837741 None] Lock "cinder-0924405f-934f-490f-a48e-0964a573984c-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:06:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-ec577b35-c49e-4a3c-a10f-910d8695b044 req-76d5d1c6-4368-4b10-ad9c-849794615a80 tempest-VolumesSnapshotsTestJSON-1182837741 None] Acquiring lock "cinder-quobyte-0924405f-934f-490f-a48e-0964a573984c" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:06:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-ec577b35-c49e-4a3c-a10f-910d8695b044 req-76d5d1c6-4368-4b10-ad9c-849794615a80 tempest-VolumesSnapshotsTestJSON-1182837741 None] Lock "cinder-quobyte-0924405f-934f-490f-a48e-0964a573984c" acquired by "delete_volume" :: waited 0.040s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:06:01 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c16300-db0d-414e-bbda-b65da7f89a59]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:06:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-ec577b35-c49e-4a3c-a10f-910d8695b044 req-76d5d1c6-4368-4b10-ad9c-849794615a80 tempest-VolumesSnapshotsTestJSON-1182837741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:02 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c Sep 01 12:06:02 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:02 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-ec577b35-c49e-4a3c-a10f-910d8695b044 req-76d5d1c6-4368-4b10-ad9c-849794615a80 tempest-VolumesSnapshotsTestJSON-1182837741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c" returned: 0 in 0.478s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-ec577b35-c49e-4a3c-a10f-910d8695b044 req-76d5d1c6-4368-4b10-ad9c-849794615a80 tempest-VolumesSnapshotsTestJSON-1182837741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:02 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c Sep 01 12:06:02 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:02 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-ec577b35-c49e-4a3c-a10f-910d8695b044 req-76d5d1c6-4368-4b10-ad9c-849794615a80 tempest-VolumesSnapshotsTestJSON-1182837741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0924405f-934f-490f-a48e-0964a573984c" returned: 0 in 0.341s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-ec577b35-c49e-4a3c-a10f-910d8695b044 req-76d5d1c6-4368-4b10-ad9c-849794615a80 tempest-VolumesSnapshotsTestJSON-1182837741 None] Lock "cinder-quobyte-0924405f-934f-490f-a48e-0964a573984c" released by "delete_volume" :: held 0.933s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:06:02 devstack cinder-volume[87084]: DEBUG cinder.quota [req-ec577b35-c49e-4a3c-a10f-910d8695b044 req-76d5d1c6-4368-4b10-ad9c-849794615a80 tempest-VolumesSnapshotsTestJSON-1182837741 None] Created reservations ['0af31f1f-7712-4f6b-802c-ef1efafcc222', 'c49cde18-199f-407b-a15f-09646b9fba40', 'be066949-1076-4e6e-af13-41b4b4e86419', '7804c2f7-3c69-4236-8d6c-5cc71f19a8aa'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:06:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-ec577b35-c49e-4a3c-a10f-910d8695b044 req-76d5d1c6-4368-4b10-ad9c-849794615a80 tempest-VolumesSnapshotsTestJSON-1182837741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:06:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-ec577b35-c49e-4a3c-a10f-910d8695b044 req-76d5d1c6-4368-4b10-ad9c-849794615a80 tempest-VolumesSnapshotsTestJSON-1182837741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:06:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-ec577b35-c49e-4a3c-a10f-910d8695b044 req-76d5d1c6-4368-4b10-ad9c-849794615a80 tempest-VolumesSnapshotsTestJSON-1182837741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:06:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-ec577b35-c49e-4a3c-a10f-910d8695b044 req-76d5d1c6-4368-4b10-ad9c-849794615a80 tempest-VolumesSnapshotsTestJSON-1182837741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:06:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-ec577b35-c49e-4a3c-a10f-910d8695b044 req-76d5d1c6-4368-4b10-ad9c-849794615a80 tempest-VolumesSnapshotsTestJSON-1182837741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:06:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-ec577b35-c49e-4a3c-a10f-910d8695b044 req-76d5d1c6-4368-4b10-ad9c-849794615a80 tempest-VolumesSnapshotsTestJSON-1182837741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:03 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:06:03 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:03 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-ec577b35-c49e-4a3c-a10f-910d8695b044 req-76d5d1c6-4368-4b10-ad9c-849794615a80 tempest-VolumesSnapshotsTestJSON-1182837741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.314s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:03 devstack cinder-volume[87084]: DEBUG cinder.manager [req-ec577b35-c49e-4a3c-a10f-910d8695b044 req-76d5d1c6-4368-4b10-ad9c-849794615a80 tempest-VolumesSnapshotsTestJSON-1182837741 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:06:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-ec577b35-c49e-4a3c-a10f-910d8695b044 req-76d5d1c6-4368-4b10-ad9c-849794615a80 tempest-VolumesSnapshotsTestJSON-1182837741 None] Deleted volume successfully. Sep 01 12:06:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-ec577b35-c49e-4a3c-a10f-910d8695b044 req-76d5d1c6-4368-4b10-ad9c-849794615a80 tempest-VolumesSnapshotsTestJSON-1182837741 None] Lock "cinder-0924405f-934f-490f-a48e-0964a573984c-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:06:09 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-58287317-9d8f-4039-9f17-eb891226dc27 tempest-GroupSnapshotsTest-411555266 None] Group tempest-GroupSnapshotsTest-Group-206485928: creating Sep 01 12:06:09 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-58287317-9d8f-4039-9f17-eb891226dc27 tempest-GroupSnapshotsTest-411555266 None] Group tempest-GroupSnapshotsTest-Group-206485928: created successfully Sep 01 12:06:09 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-58287317-9d8f-4039-9f17-eb891226dc27 tempest-GroupSnapshotsTest-411555266 None] Create group completed successfully. Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Flow 'volume_create_manager' (bd0ea334-70f6-4721-82bf-82e4018fc43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa2a787-70e9-4656-850d-747310ff07ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa2a787-70e9-4656-850d-747310ff07ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1873244990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=edf98ce0-de0e-4353-a39b-5415d073845b,host='devstack@QuobyteHD#QuobyteHD',id=aa4aa70d-94a1-4662-bdcf-f20ff8959b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f51bcb554df4b7aa6b4518753c5736c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:06:12Z,use_quota=True,user_id='e7c2b950d9c447f4b9f33c54457482fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c7f656-45b8-40ce-941b-219d2eea99e8),volume_type_id=d7c7f656-45b8-40ce-941b-219d2eea99e8)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3aadcf6-5b69-408d-900e-dd00fabcbe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3aadcf6-5b69-408d-900e-dd00fabcbe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c525502c-ac06-445e-ba86-574d2d24d82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c525502c-ac06-445e-ba86-574d2d24d82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa4aa70d-94a1-4662-bdcf-f20ff8959b6b', 'volume_name': 'volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6119ed-d15b-401a-ba20-63270dfec688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6119ed-d15b-401a-ba20-63270dfec688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee392b1-e45a-4a4f-a649-f1de51af5c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:11 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Volume aa4aa70d-94a1-4662-bdcf-f20ff8959b6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b', 'volume_size': 1} Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=edf98ce0-de0e-4353-a39b-5415d073845b,created_at=2026-09-01T10:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1873244990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=edf98ce0-de0e-4353-a39b-5415d073845b,host='devstack@QuobyteHD#QuobyteHD',id=aa4aa70d-94a1-4662-bdcf-f20ff8959b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f51bcb554df4b7aa6b4518753c5736c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:06:12Z,use_quota=True,user_id='e7c2b950d9c447f4b9f33c54457482fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c7f656-45b8-40ce-941b-219d2eea99e8),volume_type_id=d7c7f656-45b8-40ce-941b-219d2eea99e8)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Creating volume aa4aa70d-94a1-4662-bdcf-f20ff8959b6b {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:06:11 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:06:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:11 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b 1073741824 Sep 01 12:06:11 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:12 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b 1073741824" returned: 0 in 0.757s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:12 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b Sep 01 12:06:12 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:12 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b" returned: 0 in 0.385s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:06:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:06:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee392b1-e45a-4a4f-a649-f1de51af5c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1afecb-10aa-4521-8b4c-7452879a5d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:12 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Volume volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b (aa4aa70d-94a1-4662-bdcf-f20ff8959b6b): created successfully Sep 01 12:06:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1afecb-10aa-4521-8b4c-7452879a5d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Flow 'volume_create_manager' (bd0ea334-70f6-4721-82bf-82e4018fc43d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:06:13 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-bff95ea0-ef40-4e51-b34b-49a691221327 tempest-GroupSnapshotsTest-411555266 None] Created volume successfully. Sep 01 12:06:14 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9e828bd2-35b0-454d-842f-5c5c14e2b3ea tempest-GroupSnapshotsTest-411555266 None] GroupSnapshot 7374339d-d0b7-4e56-8dc7-afe1b3cdfe68: creating. Sep 01 12:06:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9e828bd2-35b0-454d-842f-5c5c14e2b3ea tempest-GroupSnapshotsTest-411555266 None] Group snapshot 7374339d-d0b7-4e56-8dc7-afe1b3cdfe68: creating. {{(pid=87084) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 12:06:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9e828bd2-35b0-454d-842f-5c5c14e2b3ea tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:06:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9e828bd2-35b0-454d-842f-5c5c14e2b3ea tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:06:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9e828bd2-35b0-454d-842f-5c5c14e2b3ea tempest-GroupSnapshotsTest-411555266 None] Creating offline snapshot c003824f-6142-4d3c-9131-6ca9fb0ea8aa of volume aa4aa70d-94a1-4662-bdcf-f20ff8959b6b {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:06:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ae858b-bfe0-478a-bcee-28e34894ab64]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:06:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9e828bd2-35b0-454d-842f-5c5c14e2b3ea tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:15 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b Sep 01 12:06:15 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:15 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9e828bd2-35b0-454d-842f-5c5c14e2b3ea tempest-GroupSnapshotsTest-411555266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b" returned: 0 in 0.438s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9e828bd2-35b0-454d-842f-5c5c14e2b3ea tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:15 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa 1G Sep 01 12:06:15 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:15 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9e828bd2-35b0-454d-842f-5c5c14e2b3ea tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa 1G" returned: 0 in 0.554s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9e828bd2-35b0-454d-842f-5c5c14e2b3ea tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:15 devstack sudo[89328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa Sep 01 12:06:15 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:16 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9e828bd2-35b0-454d-842f-5c5c14e2b3ea tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa" returned: 0 in 0.430s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:16 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-9e828bd2-35b0-454d-842f-5c5c14e2b3ea tempest-GroupSnapshotsTest-411555266 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:06:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9e828bd2-35b0-454d-842f-5c5c14e2b3ea tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:16 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa Sep 01 12:06:16 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:16 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9e828bd2-35b0-454d-842f-5c5c14e2b3ea tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa" returned: 0 in 0.301s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9e828bd2-35b0-454d-842f-5c5c14e2b3ea tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:16 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.info Sep 01 12:06:16 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:17 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9e828bd2-35b0-454d-842f-5c5c14e2b3ea tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.info" returned: 0 in 0.310s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:17 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-9e828bd2-35b0-454d-842f-5c5c14e2b3ea tempest-GroupSnapshotsTest-411555266 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:06:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9e828bd2-35b0-454d-842f-5c5c14e2b3ea tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:17 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.info Sep 01 12:06:17 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:17 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9e828bd2-35b0-454d-842f-5c5c14e2b3ea tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.info" returned: 0 in 0.382s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9e828bd2-35b0-454d-842f-5c5c14e2b3ea tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.521s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:06:17 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9e828bd2-35b0-454d-842f-5c5c14e2b3ea tempest-GroupSnapshotsTest-411555266 None] group_snapshot 7374339d-d0b7-4e56-8dc7-afe1b3cdfe68: created successfully Sep 01 12:06:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:06:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:06:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "cinder-quobyte-c003824f-6142-4d3c-9131-6ca9fb0ea8aa-2058a472-690f-4a4a-a26b-c1107f6e7659" by "_create_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:06:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-c003824f-6142-4d3c-9131-6ca9fb0ea8aa-2058a472-690f-4a4a-a26b-c1107f6e7659" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:06:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Creating volume 2058a472-690f-4a4a-a26b-c1107f6e7659 from snapshot c003824f-6142-4d3c-9131-6ca9fb0ea8aa {{(pid=87084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 12:06:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:06:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:06:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:06:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:06:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:06:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:06:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "cinder-quobyte-2058a472-690f-4a4a-a26b-c1107f6e7659" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:06:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-2058a472-690f-4a4a-a26b-c1107f6e7659" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:06:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] snapshot: c003824f-6142-4d3c-9131-6ca9fb0ea8aa, volume: 2058a472-690f-4a4a-a26b-c1107f6e7659, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:06:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:06:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:06:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:06:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:06:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:06:19 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0a2f86-7c4e-4bee-8d52-0d135abc5fd6]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:06:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:19 devstack sudo[89346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa Sep 01 12:06:19 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:19 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa" returned: 0 in 0.499s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:06:19 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b74b55-d70c-4d72-86d3-417e0b450b1e]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:06:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:19 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b Sep 01 12:06:19 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:19 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b" returned: 0 in 0.421s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:06:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:06:19 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Path /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2058a472-690f-4a4a-a26b-c1107f6e7659 not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:06:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2058a472-690f-4a4a-a26b-c1107f6e7659 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:19 devstack sudo[89356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2058a472-690f-4a4a-a26b-c1107f6e7659 Sep 01 12:06:19 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:25 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2058a472-690f-4a4a-a26b-c1107f6e7659" returned: 0 in 5.652s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:25 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2058a472-690f-4a4a-a26b-c1107f6e7659 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:06:25 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Converted 1024.00 MB image at 181.12 MB/s Sep 01 12:06:25 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2058a472-690f-4a4a-a26b-c1107f6e7659 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:06:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2058a472-690f-4a4a-a26b-c1107f6e7659 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:25 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2058a472-690f-4a4a-a26b-c1107f6e7659 Sep 01 12:06:25 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:25 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2058a472-690f-4a4a-a26b-c1107f6e7659" returned: 0 in 0.283s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-2058a472-690f-4a4a-a26b-c1107f6e7659" released by "_copy_volume_from_snapshot" :: held 6.970s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:06:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-c003824f-6142-4d3c-9131-6ca9fb0ea8aa-2058a472-690f-4a4a-a26b-c1107f6e7659" released by "_create_volume_from_snapshot" :: held 7.095s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:06:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.117s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:06:26 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c5f78d0c-8ada-402e-8f12-16e5bc6ac041 tempest-GroupSnapshotsTest-411555266 None] Create group from source-snapshot-7374339d-d0b7-4e56-8dc7-afe1b3cdfe68 completed successfully. Sep 01 12:06:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3cb36ea2-c0cf-4666-ae9e-f326f855803b tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "cinder-quobyte-2058a472-690f-4a4a-a26b-c1107f6e7659" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:06:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3cb36ea2-c0cf-4666-ae9e-f326f855803b tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-2058a472-690f-4a4a-a26b-c1107f6e7659" acquired by "delete_volume" :: waited 0.041s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:06:28 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad0c484-cf35-4a12-9024-18f4902d48b1]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:06:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3cb36ea2-c0cf-4666-ae9e-f326f855803b tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2058a472-690f-4a4a-a26b-c1107f6e7659 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:28 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2058a472-690f-4a4a-a26b-c1107f6e7659 Sep 01 12:06:28 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:29 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3cb36ea2-c0cf-4666-ae9e-f326f855803b tempest-GroupSnapshotsTest-411555266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2058a472-690f-4a4a-a26b-c1107f6e7659" returned: 0 in 0.667s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3cb36ea2-c0cf-4666-ae9e-f326f855803b tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2058a472-690f-4a4a-a26b-c1107f6e7659 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:29 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2058a472-690f-4a4a-a26b-c1107f6e7659 Sep 01 12:06:29 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:29 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3cb36ea2-c0cf-4666-ae9e-f326f855803b tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2058a472-690f-4a4a-a26b-c1107f6e7659" returned: 0 in 0.502s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3cb36ea2-c0cf-4666-ae9e-f326f855803b tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-2058a472-690f-4a4a-a26b-c1107f6e7659" released by "delete_volume" :: held 1.286s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:06:29 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-3cb36ea2-c0cf-4666-ae9e-f326f855803b tempest-GroupSnapshotsTest-411555266 None] Created reservations ['0be5cc8d-59a8-491d-a1b5-85cc0d2c324f'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:06:29 devstack cinder-volume[87084]: WARNING cinder.quota [None req-3cb36ea2-c0cf-4666-ae9e-f326f855803b tempest-GroupSnapshotsTest-411555266 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-823897047 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-823897047, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:06:29 devstack cinder-volume[87084]: WARNING cinder.quota [None req-3cb36ea2-c0cf-4666-ae9e-f326f855803b tempest-GroupSnapshotsTest-411555266 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-823897047 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-823897047, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:06:29 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-3cb36ea2-c0cf-4666-ae9e-f326f855803b tempest-GroupSnapshotsTest-411555266 None] Created reservations ['4123ed39-996b-4ce8-a4a9-9130f0f1f6a3', 'd00d5b01-1c72-4f3c-8f41-6822ea59390c', '972a79c1-4df1-4a50-9536-77cafa78ed53', '6d14cf9e-9be9-4985-82b2-89bf30ec852d'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:06:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3cb36ea2-c0cf-4666-ae9e-f326f855803b tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:06:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3cb36ea2-c0cf-4666-ae9e-f326f855803b tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:06:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3cb36ea2-c0cf-4666-ae9e-f326f855803b tempest-GroupSnapshotsTest-411555266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:06:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3cb36ea2-c0cf-4666-ae9e-f326f855803b tempest-GroupSnapshotsTest-411555266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:06:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3cb36ea2-c0cf-4666-ae9e-f326f855803b tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:06:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3cb36ea2-c0cf-4666-ae9e-f326f855803b tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:30 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:06:30 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:30 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3cb36ea2-c0cf-4666-ae9e-f326f855803b tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.375s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:30 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-3cb36ea2-c0cf-4666-ae9e-f326f855803b tempest-GroupSnapshotsTest-411555266 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:06:30 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3cb36ea2-c0cf-4666-ae9e-f326f855803b tempest-GroupSnapshotsTest-411555266 None] Delete group completed successfully. Sep 01 12:06:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] group_snapshot 7374339d-d0b7-4e56-8dc7-afe1b3cdfe68: deleting Sep 01 12:06:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] group_snapshot 7374339d-d0b7-4e56-8dc7-afe1b3cdfe68: deleting {{(pid=87084) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 12:06:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "cinder-quobyte-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:06:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:06:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "cinder-quobyte-c003824f-6142-4d3c-9131-6ca9fb0ea8aa" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:06:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-c003824f-6142-4d3c-9131-6ca9fb0ea8aa" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:06:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] Deleting offline snapshot c003824f-6142-4d3c-9131-6ca9fb0ea8aa of volume aa4aa70d-94a1-4662-bdcf-f20ff8959b6b {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:06:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] snapshot_file for this snap is: volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:06:31 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[164166c6-5832-46bc-885a-0d80a279964f]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:06:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:31 devstack sudo[89475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa Sep 01 12:06:31 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:32 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa" returned: 0 in 0.564s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:06:32 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeacb149-2b45-4796-894b-ee198ebf255b]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:06:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:32 devstack sudo[89481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b Sep 01 12:06:32 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:32 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b" returned: 0 in 0.554s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:32 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa Sep 01 12:06:32 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:33 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa" returned: 0 in 0.492s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:33 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa Sep 01 12:06:33 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:33 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b.c003824f-6142-4d3c-9131-6ca9fb0ea8aa" returned: 0 in 0.330s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:33 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-c003824f-6142-4d3c-9131-6ca9fb0ea8aa" released by "_delete_snapshot" :: held 2.065s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:06:33 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b" released by "delete_snapshot" :: held 2.104s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:06:33 devstack cinder-volume[87084]: WARNING cinder.quota [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-823897047 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-823897047, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:06:33 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] Created reservations ['80be6f23-8f3e-4f26-b923-b0c13b6547ef', '734c0d76-680e-4b64-b820-dfe5053c1022', 'f9ea24e7-35a2-4133-a413-cd2d4f50d6a9', 'a4a3555e-302f-46f5-b355-65ad591364c7'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:06:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-bb00a5b6-0566-4361-9542-ab9ec78e9a2e tempest-GroupSnapshotsTest-411555266 None] group_snapshot 7374339d-d0b7-4e56-8dc7-afe1b3cdfe68: deleted successfully Sep 01 12:06:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-da9f6275-203d-430f-b3b8-e59ec3caf1d4 tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "cinder-quobyte-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:06:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-da9f6275-203d-430f-b3b8-e59ec3caf1d4 tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b" acquired by "delete_volume" :: waited 0.036s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:06:34 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3e79ad-e219-4efe-86a7-d2d21c50003b]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:06:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-da9f6275-203d-430f-b3b8-e59ec3caf1d4 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:34 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b Sep 01 12:06:34 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:34 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-da9f6275-203d-430f-b3b8-e59ec3caf1d4 tempest-GroupSnapshotsTest-411555266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b" returned: 0 in 0.504s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-da9f6275-203d-430f-b3b8-e59ec3caf1d4 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:35 devstack sudo[89502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b Sep 01 12:06:35 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:35 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-da9f6275-203d-430f-b3b8-e59ec3caf1d4 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b" returned: 0 in 0.400s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-da9f6275-203d-430f-b3b8-e59ec3caf1d4 tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-aa4aa70d-94a1-4662-bdcf-f20ff8959b6b" released by "delete_volume" :: held 1.009s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:06:35 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-da9f6275-203d-430f-b3b8-e59ec3caf1d4 tempest-GroupSnapshotsTest-411555266 None] Created reservations ['2b0b2128-afbe-474f-a2c5-210170b6b6fc'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:06:35 devstack cinder-volume[87084]: WARNING cinder.db.api [None req-da9f6275-203d-430f-b3b8-e59ec3caf1d4 tempest-GroupSnapshotsTest-411555266 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-823897047'] Sep 01 12:06:35 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-da9f6275-203d-430f-b3b8-e59ec3caf1d4 tempest-GroupSnapshotsTest-411555266 None] Created reservations ['f8353914-7457-4bde-841d-bbaeb31c65b4', 'a29a5dda-6b5b-41c3-809e-03fbdb7cc1da', '8b968518-dccf-484b-963c-96526c0e859f', 'bb9076b4-e911-4bad-adbb-7ab2090a42e0'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:06:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-da9f6275-203d-430f-b3b8-e59ec3caf1d4 tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:06:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-da9f6275-203d-430f-b3b8-e59ec3caf1d4 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:06:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-da9f6275-203d-430f-b3b8-e59ec3caf1d4 tempest-GroupSnapshotsTest-411555266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:06:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-da9f6275-203d-430f-b3b8-e59ec3caf1d4 tempest-GroupSnapshotsTest-411555266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:06:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-da9f6275-203d-430f-b3b8-e59ec3caf1d4 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:06:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-da9f6275-203d-430f-b3b8-e59ec3caf1d4 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:35 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:06:35 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:36 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-da9f6275-203d-430f-b3b8-e59ec3caf1d4 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.574s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:36 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-da9f6275-203d-430f-b3b8-e59ec3caf1d4 tempest-GroupSnapshotsTest-411555266 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:06:36 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-da9f6275-203d-430f-b3b8-e59ec3caf1d4 tempest-GroupSnapshotsTest-411555266 None] Delete group completed successfully. Sep 01 12:06:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4b902755-a6a4-4493-923c-391618ac70eb tempest-GroupSnapshotsTest-411555266 None] Group tempest-GroupSnapshotsTest-Group-1280250381: creating Sep 01 12:06:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4b902755-a6a4-4493-923c-391618ac70eb tempest-GroupSnapshotsTest-411555266 None] Group tempest-GroupSnapshotsTest-Group-1280250381: created successfully Sep 01 12:06:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4b902755-a6a4-4493-923c-391618ac70eb tempest-GroupSnapshotsTest-411555266 None] Create group completed successfully. Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Flow 'volume_create_manager' (ab5db62b-3c58-4d4b-9ca3-758b7cc957dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4cf0293-86cc-4d9e-b42e-be793f892461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4cf0293-86cc-4d9e-b42e-be793f892461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-143359344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=16e714ac-b946-47dc-abd4-02e735389ff3,host='devstack@QuobyteHD#QuobyteHD',id=946fb6ff-3a00-49ab-a163-56ae0553dc2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f51bcb554df4b7aa6b4518753c5736c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:06:40Z,use_quota=True,user_id='e7c2b950d9c447f4b9f33c54457482fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13b17c24-5f7e-441a-bc34-82f750b5f0d1),volume_type_id=13b17c24-5f7e-441a-bc34-82f750b5f0d1)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c39ea79-0173-436f-924a-070a1a6b1752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c39ea79-0173-436f-924a-070a1a6b1752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c125ffd4-5311-453d-9c84-957a78e72522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c125ffd4-5311-453d-9c84-957a78e72522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '946fb6ff-3a00-49ab-a163-56ae0553dc2f', 'volume_name': 'volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a029db24-bfed-4e46-9a94-e6a5cf9096e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a029db24-bfed-4e46-9a94-e6a5cf9096e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c465ae7-3c7e-44ec-a1a3-26c22b38304f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Volume 946fb6ff-3a00-49ab-a163-56ae0553dc2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f', 'volume_size': 1} Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=16e714ac-b946-47dc-abd4-02e735389ff3,created_at=2026-09-01T10:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-143359344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=16e714ac-b946-47dc-abd4-02e735389ff3,host='devstack@QuobyteHD#QuobyteHD',id=946fb6ff-3a00-49ab-a163-56ae0553dc2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f51bcb554df4b7aa6b4518753c5736c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:06:40Z,use_quota=True,user_id='e7c2b950d9c447f4b9f33c54457482fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13b17c24-5f7e-441a-bc34-82f750b5f0d1),volume_type_id=13b17c24-5f7e-441a-bc34-82f750b5f0d1)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Creating volume 946fb6ff-3a00-49ab-a163-56ae0553dc2f {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:06:39 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:06:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:40 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f 1073741824 Sep 01 12:06:40 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:40 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f 1073741824" returned: 0 in 0.681s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:40 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f Sep 01 12:06:40 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:41 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f" returned: 0 in 0.393s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:06:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:06:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c465ae7-3c7e-44ec-a1a3-26c22b38304f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a85de1-2637-4821-b70d-664267d43d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Volume volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f (946fb6ff-3a00-49ab-a163-56ae0553dc2f): created successfully Sep 01 12:06:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a85de1-2637-4821-b70d-664267d43d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Flow 'volume_create_manager' (ab5db62b-3c58-4d4b-9ca3-758b7cc957dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:06:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c0683879-47df-4d2f-a532-dd2901dd91dd tempest-GroupSnapshotsTest-411555266 None] Created volume successfully. Sep 01 12:06:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:06:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:06:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:06:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:06:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:06:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:06:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:41 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:06:41 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:42 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.382s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Flow 'volume_create_manager' (6806758a-8c53-49eb-8dc6-a26998c9a626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58b1e77-69b7-42a2-9af7-8e6bc7f35edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58b1e77-69b7-42a2-9af7-8e6bc7f35edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2014210466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=16e714ac-b946-47dc-abd4-02e735389ff3,host='devstack@QuobyteHD#QuobyteHD',id=8f3448d8-7811-48fd-8361-9ed754f17368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f51bcb554df4b7aa6b4518753c5736c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:06:43Z,use_quota=True,user_id='e7c2b950d9c447f4b9f33c54457482fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13b17c24-5f7e-441a-bc34-82f750b5f0d1),volume_type_id=13b17c24-5f7e-441a-bc34-82f750b5f0d1)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (505dc981-f3f3-45fc-9c70-cee25813c351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (505dc981-f3f3-45fc-9c70-cee25813c351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b891f9d-2db5-47a5-9456-45ed38829e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b891f9d-2db5-47a5-9456-45ed38829e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f3448d8-7811-48fd-8361-9ed754f17368', 'volume_name': 'volume-8f3448d8-7811-48fd-8361-9ed754f17368', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76befd36-3cde-46f4-a207-5a5291757b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76befd36-3cde-46f4-a207-5a5291757b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0428da4-c94b-4375-a1e3-fa3e055fce9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:43 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Volume 8f3448d8-7811-48fd-8361-9ed754f17368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f3448d8-7811-48fd-8361-9ed754f17368', 'volume_size': 1} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=16e714ac-b946-47dc-abd4-02e735389ff3,created_at=2026-09-01T10:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2014210466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=16e714ac-b946-47dc-abd4-02e735389ff3,host='devstack@QuobyteHD#QuobyteHD',id=8f3448d8-7811-48fd-8361-9ed754f17368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f51bcb554df4b7aa6b4518753c5736c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:06:43Z,use_quota=True,user_id='e7c2b950d9c447f4b9f33c54457482fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13b17c24-5f7e-441a-bc34-82f750b5f0d1),volume_type_id=13b17c24-5f7e-441a-bc34-82f750b5f0d1)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Creating volume 8f3448d8-7811-48fd-8361-9ed754f17368 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:06:43 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:43 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368 1073741824 Sep 01 12:06:43 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:43 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368 1073741824" returned: 0 in 0.498s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:43 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368 Sep 01 12:06:43 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:44 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368" returned: 0 in 0.287s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:06:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:06:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0428da4-c94b-4375-a1e3-fa3e055fce9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f3448d8-7811-48fd-8361-9ed754f17368', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1055f79-0438-4318-be4a-fb6b571b3027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:44 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Volume volume-8f3448d8-7811-48fd-8361-9ed754f17368 (8f3448d8-7811-48fd-8361-9ed754f17368): created successfully Sep 01 12:06:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1055f79-0438-4318-be4a-fb6b571b3027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Flow 'volume_create_manager' (6806758a-8c53-49eb-8dc6-a26998c9a626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:06:44 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e7b6e55b-917b-47c6-a31c-15d69363fe3b tempest-GroupSnapshotsTest-411555266 None] Created volume successfully. Sep 01 12:06:44 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-96a72072-f4bb-4a63-9988-d2384bea4631 tempest-GroupSnapshotsTest-411555266 None] Update group completed successfully. Sep 01 12:06:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8abed5d3-b2f6-4fb3-9d1a-bd7211e6fcf4 tempest-GroupSnapshotsTest-411555266 None] Update group completed successfully. Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Flow 'volume_create_manager' (e5c78729-a123-4956-9933-115a18a96c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e87b0357-001e-4922-83ad-8b7f3a649f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e87b0357-001e-4922-83ad-8b7f3a649f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-789133450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5f572b-8860-43b2-971c-602ffb344b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fddf75c8236f4fb3b723f5b8030ff8b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:06:46Z,use_quota=True,user_id='ad982b6f1b164068bab5eb738d4204f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264b1607-321d-41e0-b8e2-f462e08ffde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264b1607-321d-41e0-b8e2-f462e08ffde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf56ea62-e018-4a7c-84e8-b7047673e7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf56ea62-e018-4a7c-84e8-b7047673e7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea5f572b-8860-43b2-971c-602ffb344b10', 'volume_name': 'volume-ea5f572b-8860-43b2-971c-602ffb344b10', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e36f2a-34f1-4fb2-9f54-3bd756772808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e36f2a-34f1-4fb2-9f54-3bd756772808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3093d5-aa3d-4772-9a5d-0f63130d7e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:46 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Volume ea5f572b-8860-43b2-971c-602ffb344b10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea5f572b-8860-43b2-971c-602ffb344b10', 'volume_size': 1} Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-789133450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5f572b-8860-43b2-971c-602ffb344b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fddf75c8236f4fb3b723f5b8030ff8b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:06:46Z,use_quota=True,user_id='ad982b6f1b164068bab5eb738d4204f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Creating volume ea5f572b-8860-43b2-971c-602ffb344b10 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:06:46 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:06:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ea5f572b-8860-43b2-971c-602ffb344b10 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:46 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ea5f572b-8860-43b2-971c-602ffb344b10 1073741824 Sep 01 12:06:46 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:46 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-50c9aa7c-6537-463e-bae9-4dedcbba6b22 tempest-GroupSnapshotsTest-411555266 None] Update group completed successfully. Sep 01 12:06:47 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ea5f572b-8860-43b2-971c-602ffb344b10 1073741824" returned: 0 in 0.539s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ea5f572b-8860-43b2-971c-602ffb344b10 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:47 devstack sudo[89557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ea5f572b-8860-43b2-971c-602ffb344b10 Sep 01 12:06:47 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:47 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ea5f572b-8860-43b2-971c-602ffb344b10" returned: 0 in 0.272s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:06:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:06:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3093d5-aa3d-4772-9a5d-0f63130d7e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea5f572b-8860-43b2-971c-602ffb344b10', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6506ab-bc69-4677-8192-7f4ff30f001b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:47 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Volume volume-ea5f572b-8860-43b2-971c-602ffb344b10 (ea5f572b-8860-43b2-971c-602ffb344b10): created successfully Sep 01 12:06:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6506ab-bc69-4677-8192-7f4ff30f001b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Flow 'volume_create_manager' (e5c78729-a123-4956-9933-115a18a96c79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:06:47 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f53f8b1b-4c37-4823-9f57-101b8a265f01 tempest-TaggedAttachmentsTest-1487015619 None] Created volume successfully. Sep 01 12:06:48 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=64,cinder:UPDATE=78,cinder:DELETE=6,cinder:INSERT=15 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:06:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b4c112a1-4e53-4168-8a57-8accacbd9e2d tempest-GroupSnapshotsTest-411555266 None] Update group completed successfully. Sep 01 12:06:50 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] GroupSnapshot d9efaab6-81a1-42f2-9041-e745946f58ea: creating. Sep 01 12:06:50 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=88,cinder:UPDATE=74,cinder:INSERT=19,cinder:DELETE=2 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:06:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] Group snapshot d9efaab6-81a1-42f2-9041-e745946f58ea: creating. {{(pid=87084) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 12:06:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:06:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:06:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] Creating offline snapshot 1c8ca99d-dab4-49b1-8dc7-118551946f73 of volume 946fb6ff-3a00-49ab-a163-56ae0553dc2f {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:06:50 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b496df-9afc-4cc8-8d49-2f5d18fb089b]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:06:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:50 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f Sep 01 12:06:50 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:50 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f" returned: 0 in 0.426s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.1c8ca99d-dab4-49b1-8dc7-118551946f73 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:50 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.1c8ca99d-dab4-49b1-8dc7-118551946f73 1G Sep 01 12:06:50 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:51 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.1c8ca99d-dab4-49b1-8dc7-118551946f73 1G" returned: 0 in 0.462s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.1c8ca99d-dab4-49b1-8dc7-118551946f73 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:51 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.1c8ca99d-dab4-49b1-8dc7-118551946f73 Sep 01 12:06:51 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:51 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.1c8ca99d-dab4-49b1-8dc7-118551946f73" returned: 0 in 0.340s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:51 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.1c8ca99d-dab4-49b1-8dc7-118551946f73 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:06:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.1c8ca99d-dab4-49b1-8dc7-118551946f73 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:51 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.1c8ca99d-dab4-49b1-8dc7-118551946f73 Sep 01 12:06:51 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:51 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.1c8ca99d-dab4-49b1-8dc7-118551946f73" returned: 0 in 0.427s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:52 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.info Sep 01 12:06:52 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:52 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.info" returned: 0 in 0.346s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:52 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:06:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:52 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.info Sep 01 12:06:52 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:52 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:06:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Flow 'volume_create_manager' (ab5f1e9b-1b5b-4cda-af76-4432b3379814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:06:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d693fe0-9d73-4134-b142-d0dc339484c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d693fe0-9d73-4134-b142-d0dc339484c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1728118055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95307a56-7b23-44f6-927d-e098de01f204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb4a63bc4d84e70a520828f5e25554a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:06:53Z,use_quota=True,user_id='f521a3a6aa2a4de6a561dcd590273e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fd7e30-a9bd-4bd2-9fd3-45b36b4cc1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fd7e30-a9bd-4bd2-9fd3-45b36b4cc1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0aa5aa-7cc5-4f82-a2a5-b0c88c0366d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0aa5aa-7cc5-4f82-a2a5-b0c88c0366d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95307a56-7b23-44f6-927d-e098de01f204', 'volume_name': 'volume-95307a56-7b23-44f6-927d-e098de01f204', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1603c70-2f79-4087-90b1-c4940fec9b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:52 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1603c70-2f79-4087-90b1-c4940fec9b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc96bbe-b93f-40c7-957b-924ad1a1670a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:52 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Volume 95307a56-7b23-44f6-927d-e098de01f204: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95307a56-7b23-44f6-927d-e098de01f204', 'volume_size': 1} Sep 01 12:06:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:06:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.info" returned: 0 in 0.590s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.763s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:06:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:06:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:06:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] Creating offline snapshot db7d418d-b6f4-4790-a422-94bc41af1bfc of volume 8f3448d8-7811-48fd-8361-9ed754f17368 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:06:53 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa7f51b-61b0-4873-bc18-541db8e35c2b]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:06:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:53 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368 Sep 01 12:06:53 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:53 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368" returned: 0 in 0.766s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.db7d418d-b6f4-4790-a422-94bc41af1bfc 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:53 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.db7d418d-b6f4-4790-a422-94bc41af1bfc 1G Sep 01 12:06:53 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:54 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.db7d418d-b6f4-4790-a422-94bc41af1bfc 1G" returned: 0 in 0.991s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f3448d8-7811-48fd-8361-9ed754f17368 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.db7d418d-b6f4-4790-a422-94bc41af1bfc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:55 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f3448d8-7811-48fd-8361-9ed754f17368 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.db7d418d-b6f4-4790-a422-94bc41af1bfc Sep 01 12:06:55 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:55 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f3448d8-7811-48fd-8361-9ed754f17368 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.db7d418d-b6f4-4790-a422-94bc41af1bfc" returned: 0 in 0.741s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:55 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.db7d418d-b6f4-4790-a422-94bc41af1bfc is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:06:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.db7d418d-b6f4-4790-a422-94bc41af1bfc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:55 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.db7d418d-b6f4-4790-a422-94bc41af1bfc Sep 01 12:06:55 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:56 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.db7d418d-b6f4-4790-a422-94bc41af1bfc" returned: 0 in 0.612s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:56 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.info Sep 01 12:06:56 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:56 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.info" returned: 0 in 0.526s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:56 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:06:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:56 devstack sudo[89729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.info Sep 01 12:06:56 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:57 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.info" returned: 0 in 0.591s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.433s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:06:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.502s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:06:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1728118055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95307a56-7b23-44f6-927d-e098de01f204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb4a63bc4d84e70a520828f5e25554a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:06:53Z,use_quota=True,user_id='f521a3a6aa2a4de6a561dcd590273e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:06:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Creating volume 95307a56-7b23-44f6-927d-e098de01f204 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:06:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:06:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:06:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:06:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:06:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:06:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:06:57 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:06:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-95307a56-7b23-44f6-927d-e098de01f204 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:57 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-95307a56-7b23-44f6-927d-e098de01f204 1073741824 Sep 01 12:06:57 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0b8366a5-c1ce-4068-a071-7c0af743c620 tempest-GroupSnapshotsTest-411555266 None] group_snapshot d9efaab6-81a1-42f2-9041-e745946f58ea: created successfully Sep 01 12:06:58 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] group_snapshot d9efaab6-81a1-42f2-9041-e745946f58ea: deleting Sep 01 12:06:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] group_snapshot d9efaab6-81a1-42f2-9041-e745946f58ea: deleting {{(pid=87084) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 12:06:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "cinder-quobyte-946fb6ff-3a00-49ab-a163-56ae0553dc2f" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:06:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-946fb6ff-3a00-49ab-a163-56ae0553dc2f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:06:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "cinder-quobyte-1c8ca99d-dab4-49b1-8dc7-118551946f73" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:06:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-1c8ca99d-dab4-49b1-8dc7-118551946f73" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:06:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Deleting offline snapshot 1c8ca99d-dab4-49b1-8dc7-118551946f73 of volume 946fb6ff-3a00-49ab-a163-56ae0553dc2f {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:06:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] snapshot_file for this snap is: volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.1c8ca99d-dab4-49b1-8dc7-118551946f73 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:06:58 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:58 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d14cf3a-699d-435a-b856-564e5024beba]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:06:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.1c8ca99d-dab4-49b1-8dc7-118551946f73 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-95307a56-7b23-44f6-927d-e098de01f204 1073741824" returned: 0 in 0.994s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-95307a56-7b23-44f6-927d-e098de01f204 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:58 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-95307a56-7b23-44f6-927d-e098de01f204 Sep 01 12:06:58 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:58 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.1c8ca99d-dab4-49b1-8dc7-118551946f73 Sep 01 12:06:58 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:59 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-95307a56-7b23-44f6-927d-e098de01f204" returned: 0 in 0.570s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:06:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:06:59 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc96bbe-b93f-40c7-957b-924ad1a1670a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95307a56-7b23-44f6-927d-e098de01f204', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f490f9af-3741-4922-98e0-90ad441d52c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:06:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.1c8ca99d-dab4-49b1-8dc7-118551946f73" returned: 0 in 0.705s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:06:59 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Volume volume-95307a56-7b23-44f6-927d-e098de01f204 (95307a56-7b23-44f6-927d-e098de01f204): created successfully Sep 01 12:06:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f490f9af-3741-4922-98e0-90ad441d52c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:06:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Flow 'volume_create_manager' (ab5f1e9b-1b5b-4cda-af76-4432b3379814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:06:59 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5aa5318-163f-498e-a7ba-aad66b5fa7c0]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:06:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:59 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7dda0826-8692-44d0-a8f7-c41a38dc16cb tempest-ServerActionsTestOtherA-1571640185 None] Created volume successfully. Sep 01 12:06:59 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f Sep 01 12:06:59 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:06:59 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Sep 01 12:06:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f" returned: 0 in 0.464s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:06:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.1c8ca99d-dab4-49b1-8dc7-118551946f73 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:06:59 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.1c8ca99d-dab4-49b1-8dc7-118551946f73 Sep 01 12:06:59 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:00 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.1c8ca99d-dab4-49b1-8dc7-118551946f73" returned: 0 in 0.710s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.1c8ca99d-dab4-49b1-8dc7-118551946f73 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:00 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.1c8ca99d-dab4-49b1-8dc7-118551946f73 Sep 01 12:07:00 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:00 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f.1c8ca99d-dab4-49b1-8dc7-118551946f73" returned: 0 in 0.592s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-1c8ca99d-dab4-49b1-8dc7-118551946f73" released by "_delete_snapshot" :: held 2.678s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:07:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-946fb6ff-3a00-49ab-a163-56ae0553dc2f" released by "delete_snapshot" :: held 2.737s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:07:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "cinder-quobyte-8f3448d8-7811-48fd-8361-9ed754f17368" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:07:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-8f3448d8-7811-48fd-8361-9ed754f17368" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:07:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "cinder-quobyte-db7d418d-b6f4-4790-a422-94bc41af1bfc" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:07:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-db7d418d-b6f4-4790-a422-94bc41af1bfc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:07:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Deleting offline snapshot db7d418d-b6f4-4790-a422-94bc41af1bfc of volume 8f3448d8-7811-48fd-8361-9ed754f17368 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:07:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] snapshot_file for this snap is: volume-8f3448d8-7811-48fd-8361-9ed754f17368.db7d418d-b6f4-4790-a422-94bc41af1bfc {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:07:01 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fc7531-ef54-404a-ba73-0162b95eef3e]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.db7d418d-b6f4-4790-a422-94bc41af1bfc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:01 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.db7d418d-b6f4-4790-a422-94bc41af1bfc Sep 01 12:07:01 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:01 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.db7d418d-b6f4-4790-a422-94bc41af1bfc" returned: 0 in 0.598s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f3448d8-7811-48fd-8361-9ed754f17368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:07:01 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b641b2-1f0a-448e-977a-cee8ccc424de]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:02 devstack sudo[89790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368 Sep 01 12:07:02 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:02 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368" returned: 0 in 1.014s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.db7d418d-b6f4-4790-a422-94bc41af1bfc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:02 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.db7d418d-b6f4-4790-a422-94bc41af1bfc Sep 01 12:07:02 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.db7d418d-b6f4-4790-a422-94bc41af1bfc" returned: 0 in 0.988s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:03 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.db7d418d-b6f4-4790-a422-94bc41af1bfc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:03 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.db7d418d-b6f4-4790-a422-94bc41af1bfc Sep 01 12:07:03 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:04 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368.db7d418d-b6f4-4790-a422-94bc41af1bfc" returned: 0 in 0.496s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-db7d418d-b6f4-4790-a422-94bc41af1bfc" released by "_delete_snapshot" :: held 3.246s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:07:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-8f3448d8-7811-48fd-8361-9ed754f17368" released by "delete_snapshot" :: held 3.286s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:07:04 devstack cinder-volume[87084]: WARNING cinder.quota [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1185131785 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1185131785, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:07:04 devstack cinder-volume[87084]: WARNING cinder.quota [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1185131785 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1185131785, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:07:04 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Created reservations ['2e4b2d8d-c087-463f-a883-1359a849d592', 'fe05fcc4-b953-42b7-bc92-70954855aeb8', 'eb08288d-9527-4b78-b682-9eb068e2d003', '7dfdf93b-afcc-43fb-8a8d-fe7b9990bbdf'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:07:04 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] Created reservations ['ba93f843-e747-4427-bb48-5dd12de9abef', 'bb903047-bb11-46f5-89dc-d555ee229a48', '825a239d-37a5-4c8b-8d08-61e05582d7f5', '1f0617ac-0bcd-4519-a24f-ba46a4e82f39'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:07:05 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c210b734-e0f1-4992-a3e6-5baee8ce1140 tempest-GroupSnapshotsTest-411555266 None] group_snapshot d9efaab6-81a1-42f2-9041-e745946f58ea: deleted successfully Sep 01 12:07:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "cinder-quobyte-8f3448d8-7811-48fd-8361-9ed754f17368" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:07:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-8f3448d8-7811-48fd-8361-9ed754f17368" acquired by "delete_volume" :: waited 0.042s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:07:06 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce59162-124c-433b-9b60-532c97d2fb58]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:06 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368 Sep 01 12:07:06 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:07 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368" returned: 0 in 0.818s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:07 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368 Sep 01 12:07:07 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:07 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f3448d8-7811-48fd-8361-9ed754f17368" returned: 0 in 0.581s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-8f3448d8-7811-48fd-8361-9ed754f17368" released by "delete_volume" :: held 1.570s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:07:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "cinder-quobyte-946fb6ff-3a00-49ab-a163-56ae0553dc2f" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:07:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-946fb6ff-3a00-49ab-a163-56ae0553dc2f" acquired by "delete_volume" :: waited 0.036s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:07:07 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[44adf1e8-b0c1-4c65-bcbe-2eec087632b9]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:08 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f Sep 01 12:07:08 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:08 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f" returned: 0 in 0.686s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:08 devstack sudo[89935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f Sep 01 12:07:08 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:08 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-946fb6ff-3a00-49ab-a163-56ae0553dc2f" returned: 0 in 0.362s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-946fb6ff-3a00-49ab-a163-56ae0553dc2f" released by "delete_volume" :: held 1.140s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:07:09 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Created reservations ['037b9469-c3e1-4806-92ad-40990d4ca964'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:07:09 devstack cinder-volume[87084]: WARNING cinder.quota [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1185131785 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1185131785, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:07:09 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Created reservations ['c0746b10-72c0-44d1-a3db-f5b218e8661d', '3e70812f-f483-4e49-b06d-e668faaa89a5', 'c9e9a73d-7403-4cc4-99fb-74798ac04211', '7a55514e-216e-414b-91e5-c798ad1a7d6a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:07:09 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Created reservations ['1eb26e2a-09cb-4b08-a039-d5675831ac9c', 'fbaa3db7-aba5-45ca-ba21-a9a2e3289978', 'a05f2fda-2ca3-4276-b422-94f69ad7f617', '8014aeb6-d8b0-4ad5-b7d7-be45f97b2d43'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:07:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:07:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:07:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:07:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:07:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:07:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:09 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:07:09 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:10 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.680s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:10 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:07:10 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8952eab6-a4ef-453a-a1bc-9cfd816b728d tempest-GroupSnapshotsTest-411555266 None] Delete group completed successfully. Sep 01 12:07:10 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-397e0198-98bc-42e6-ad18-833e3ca68ba2 tempest-GroupSnapshotsTest-411555266 None] Group tempest-GroupSnapshotsTest-Group-547914042: creating Sep 01 12:07:10 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-397e0198-98bc-42e6-ad18-833e3ca68ba2 tempest-GroupSnapshotsTest-411555266 None] Group tempest-GroupSnapshotsTest-Group-547914042: created successfully Sep 01 12:07:10 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-397e0198-98bc-42e6-ad18-833e3ca68ba2 tempest-GroupSnapshotsTest-411555266 None] Create group completed successfully. Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Flow 'volume_create_manager' (b2f8e1a2-bab0-4e6b-9684-e30b4e8a9631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da01d5c6-ca1d-422b-af2a-4b379ff7702d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da01d5c6-ca1d-422b-af2a-4b379ff7702d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-732159404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=88d2bf38-6818-4421-8dae-aa81adc04dcf,host='devstack@QuobyteHD#QuobyteHD',id=0a6a0107-7271-4c52-919d-bc11dfb1ec34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f51bcb554df4b7aa6b4518753c5736c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:07:13Z,use_quota=True,user_id='e7c2b950d9c447f4b9f33c54457482fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9a15eec-ed18-42fd-9cd8-6da591b001c3),volume_type_id=e9a15eec-ed18-42fd-9cd8-6da591b001c3)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37cda2a-f0df-4cfa-b46f-d311d181284f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37cda2a-f0df-4cfa-b46f-d311d181284f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20c6145-5f84-4f3b-aca4-3734159d6a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20c6145-5f84-4f3b-aca4-3734159d6a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a6a0107-7271-4c52-919d-bc11dfb1ec34', 'volume_name': 'volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fb9a6b-b0b6-42c1-bd66-fcdb6bc2c199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fb9a6b-b0b6-42c1-bd66-fcdb6bc2c199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f12abfc-62e7-4d38-9985-913899429bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:07:12 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Volume 0a6a0107-7271-4c52-919d-bc11dfb1ec34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34', 'volume_size': 1} Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=88d2bf38-6818-4421-8dae-aa81adc04dcf,created_at=2026-09-01T10:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-732159404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=88d2bf38-6818-4421-8dae-aa81adc04dcf,host='devstack@QuobyteHD#QuobyteHD',id=0a6a0107-7271-4c52-919d-bc11dfb1ec34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f51bcb554df4b7aa6b4518753c5736c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:07:13Z,use_quota=True,user_id='e7c2b950d9c447f4b9f33c54457482fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9a15eec-ed18-42fd-9cd8-6da591b001c3),volume_type_id=e9a15eec-ed18-42fd-9cd8-6da591b001c3)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Creating volume 0a6a0107-7271-4c52-919d-bc11dfb1ec34 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:07:12 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:07:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:12 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34 1073741824 Sep 01 12:07:12 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:13 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34 1073741824" returned: 0 in 0.577s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:13 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34 Sep 01 12:07:13 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:13 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34" returned: 0 in 0.359s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:07:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:07:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f12abfc-62e7-4d38-9985-913899429bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:07:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8140ed-2fb8-4f4a-8e8e-5128a5238e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:07:13 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Volume volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34 (0a6a0107-7271-4c52-919d-bc11dfb1ec34): created successfully Sep 01 12:07:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8140ed-2fb8-4f4a-8e8e-5128a5238e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:07:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Flow 'volume_create_manager' (b2f8e1a2-bab0-4e6b-9684-e30b4e8a9631) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:07:13 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-915de32d-639b-4c9a-af56-29e023c2d101 tempest-GroupSnapshotsTest-411555266 None] Created volume successfully. Sep 01 12:07:14 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-91317dfb-1f1e-4410-8198-3225001649f5 tempest-GroupSnapshotsTest-411555266 None] GroupSnapshot 717293f2-632a-4fa2-be93-3638f672dcb4: creating. Sep 01 12:07:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-91317dfb-1f1e-4410-8198-3225001649f5 tempest-GroupSnapshotsTest-411555266 None] Group snapshot 717293f2-632a-4fa2-be93-3638f672dcb4: creating. {{(pid=87084) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 12:07:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-91317dfb-1f1e-4410-8198-3225001649f5 tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:07:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-91317dfb-1f1e-4410-8198-3225001649f5 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:07:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-91317dfb-1f1e-4410-8198-3225001649f5 tempest-GroupSnapshotsTest-411555266 None] Creating offline snapshot 9a9f407d-afe0-4c4a-a966-c03b3330db1a of volume 0a6a0107-7271-4c52-919d-bc11dfb1ec34 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:07:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a003b261-9551-4016-9d75-32ccb26659a3]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-91317dfb-1f1e-4410-8198-3225001649f5 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:14 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34 Sep 01 12:07:14 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:15 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-91317dfb-1f1e-4410-8198-3225001649f5 tempest-GroupSnapshotsTest-411555266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34" returned: 0 in 0.694s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-91317dfb-1f1e-4410-8198-3225001649f5 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.9a9f407d-afe0-4c4a-a966-c03b3330db1a 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:15 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.9a9f407d-afe0-4c4a-a966-c03b3330db1a 1G Sep 01 12:07:15 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:15 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-91317dfb-1f1e-4410-8198-3225001649f5 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.9a9f407d-afe0-4c4a-a966-c03b3330db1a 1G" returned: 0 in 0.491s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-91317dfb-1f1e-4410-8198-3225001649f5 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.9a9f407d-afe0-4c4a-a966-c03b3330db1a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:15 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.9a9f407d-afe0-4c4a-a966-c03b3330db1a Sep 01 12:07:15 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:15 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-91317dfb-1f1e-4410-8198-3225001649f5 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.9a9f407d-afe0-4c4a-a966-c03b3330db1a" returned: 0 in 0.312s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:15 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-91317dfb-1f1e-4410-8198-3225001649f5 tempest-GroupSnapshotsTest-411555266 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.9a9f407d-afe0-4c4a-a966-c03b3330db1a is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:07:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-91317dfb-1f1e-4410-8198-3225001649f5 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.9a9f407d-afe0-4c4a-a966-c03b3330db1a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:16 devstack sudo[90054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.9a9f407d-afe0-4c4a-a966-c03b3330db1a Sep 01 12:07:16 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:16 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-91317dfb-1f1e-4410-8198-3225001649f5 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.9a9f407d-afe0-4c4a-a966-c03b3330db1a" returned: 0 in 0.290s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-91317dfb-1f1e-4410-8198-3225001649f5 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:16 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.info Sep 01 12:07:16 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:16 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-91317dfb-1f1e-4410-8198-3225001649f5 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.info" returned: 0 in 0.271s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:16 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-91317dfb-1f1e-4410-8198-3225001649f5 tempest-GroupSnapshotsTest-411555266 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:07:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-91317dfb-1f1e-4410-8198-3225001649f5 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:16 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.info Sep 01 12:07:16 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:16 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-91317dfb-1f1e-4410-8198-3225001649f5 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.info" returned: 0 in 0.244s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-91317dfb-1f1e-4410-8198-3225001649f5 tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.422s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:07:16 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-91317dfb-1f1e-4410-8198-3225001649f5 tempest-GroupSnapshotsTest-411555266 None] group_snapshot 717293f2-632a-4fa2-be93-3638f672dcb4: created successfully Sep 01 12:07:17 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] group_snapshot 717293f2-632a-4fa2-be93-3638f672dcb4: deleting Sep 01 12:07:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] group_snapshot 717293f2-632a-4fa2-be93-3638f672dcb4: deleting {{(pid=87084) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 12:07:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "cinder-quobyte-0a6a0107-7271-4c52-919d-bc11dfb1ec34" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:07:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-0a6a0107-7271-4c52-919d-bc11dfb1ec34" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:07:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "cinder-quobyte-9a9f407d-afe0-4c4a-a966-c03b3330db1a" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:07:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-9a9f407d-afe0-4c4a-a966-c03b3330db1a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:07:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] Deleting offline snapshot 9a9f407d-afe0-4c4a-a966-c03b3330db1a of volume 0a6a0107-7271-4c52-919d-bc11dfb1ec34 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:07:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] snapshot_file for this snap is: volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.9a9f407d-afe0-4c4a-a966-c03b3330db1a {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:07:18 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c781ebd-964e-4277-92fd-50c0bf8c3663]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.9a9f407d-afe0-4c4a-a966-c03b3330db1a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:18 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.9a9f407d-afe0-4c4a-a966-c03b3330db1a Sep 01 12:07:18 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:18 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.9a9f407d-afe0-4c4a-a966-c03b3330db1a" returned: 0 in 0.422s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:07:18 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8864d7e5-b799-400e-aa18-9bd22b1cd4ed]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:18 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34 Sep 01 12:07:18 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:18 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34" returned: 0 in 0.425s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.9a9f407d-afe0-4c4a-a966-c03b3330db1a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:19 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.9a9f407d-afe0-4c4a-a966-c03b3330db1a Sep 01 12:07:19 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:19 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.9a9f407d-afe0-4c4a-a966-c03b3330db1a" returned: 0 in 0.452s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.9a9f407d-afe0-4c4a-a966-c03b3330db1a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:19 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.9a9f407d-afe0-4c4a-a966-c03b3330db1a Sep 01 12:07:19 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:19 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34.9a9f407d-afe0-4c4a-a966-c03b3330db1a" returned: 0 in 0.304s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-9a9f407d-afe0-4c4a-a966-c03b3330db1a" released by "_delete_snapshot" :: held 1.729s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:07:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-0a6a0107-7271-4c52-919d-bc11dfb1ec34" released by "delete_snapshot" :: held 1.770s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:07:19 devstack cinder-volume[87084]: WARNING cinder.quota [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-582899096 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-582899096, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:07:19 devstack cinder-volume[87084]: WARNING cinder.quota [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-582899096 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-582899096, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:07:19 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] Created reservations ['d1772f3e-db4b-4f16-9a66-c9cfe303b247', '288c0b7b-21d4-4c04-a552-b204bb32eb76', 'ff042890-918f-4bea-87ea-96c3e3ac260c', 'c63e7986-e8e4-47ed-b148-d31e81b4b25b'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:07:20 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6e099784-ca59-4121-ba20-ea8d3876ac09 tempest-GroupSnapshotsTest-411555266 None] group_snapshot 717293f2-632a-4fa2-be93-3638f672dcb4: deleted successfully Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Flow 'volume_create_manager' (30ac9555-314f-4bd4-a4ce-c7d7e6ec97c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9e7002-1a4e-43bd-b5be-273b3e102f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9e7002-1a4e-43bd-b5be-273b3e102f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-643028136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad19e43e-910c-44da-b384-4c81f081e81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0ababc7f215448abdc4f82aa4be91a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:07:20Z,use_quota=True,user_id='90388626c4204528ab5f133fc59378fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00f848c-a314-4a4c-96a7-23601518faae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00f848c-a314-4a4c-96a7-23601518faae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61fb2fd-58d3-49ef-8811-4e44a0d5ac2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61fb2fd-58d3-49ef-8811-4e44a0d5ac2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad19e43e-910c-44da-b384-4c81f081e81e', 'volume_name': 'volume-ad19e43e-910c-44da-b384-4c81f081e81e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e00ae5-faeb-43bd-82da-28a9a0f85020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e00ae5-faeb-43bd-82da-28a9a0f85020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2edb39-3182-41a6-b955-0be05e83634e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:07:20 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Volume ad19e43e-910c-44da-b384-4c81f081e81e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad19e43e-910c-44da-b384-4c81f081e81e', 'volume_size': 1} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-643028136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad19e43e-910c-44da-b384-4c81f081e81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0ababc7f215448abdc4f82aa4be91a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:07:20Z,use_quota=True,user_id='90388626c4204528ab5f133fc59378fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Creating volume ad19e43e-910c-44da-b384-4c81f081e81e {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:07:20 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ad19e43e-910c-44da-b384-4c81f081e81e 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:20 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ad19e43e-910c-44da-b384-4c81f081e81e 1073741824 Sep 01 12:07:20 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37c9fb8e-3b95-4d3f-ac68-a89847da202b tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "cinder-quobyte-0a6a0107-7271-4c52-919d-bc11dfb1ec34" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37c9fb8e-3b95-4d3f-ac68-a89847da202b tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-0a6a0107-7271-4c52-919d-bc11dfb1ec34" acquired by "delete_volume" :: waited 0.040s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4c7936-82ab-4ca9-9640-a19bcced84b6]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37c9fb8e-3b95-4d3f-ac68-a89847da202b tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:20 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34 Sep 01 12:07:20 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:21 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ad19e43e-910c-44da-b384-4c81f081e81e 1073741824" returned: 0 in 0.538s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:21 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37c9fb8e-3b95-4d3f-ac68-a89847da202b tempest-GroupSnapshotsTest-411555266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34" returned: 0 in 0.399s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37c9fb8e-3b95-4d3f-ac68-a89847da202b tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ad19e43e-910c-44da-b384-4c81f081e81e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:21 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34 Sep 01 12:07:21 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:21 devstack sudo[90124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ad19e43e-910c-44da-b384-4c81f081e81e Sep 01 12:07:21 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:21 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37c9fb8e-3b95-4d3f-ac68-a89847da202b tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0a6a0107-7271-4c52-919d-bc11dfb1ec34" returned: 0 in 0.257s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37c9fb8e-3b95-4d3f-ac68-a89847da202b tempest-GroupSnapshotsTest-411555266 None] Lock "cinder-quobyte-0a6a0107-7271-4c52-919d-bc11dfb1ec34" released by "delete_volume" :: held 0.744s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:07:21 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ad19e43e-910c-44da-b384-4c81f081e81e" returned: 0 in 0.308s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:07:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:07:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2edb39-3182-41a6-b955-0be05e83634e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad19e43e-910c-44da-b384-4c81f081e81e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:07:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36064dda-1e8c-4b68-bbbf-906f1162e9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:07:21 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-37c9fb8e-3b95-4d3f-ac68-a89847da202b tempest-GroupSnapshotsTest-411555266 None] Created reservations ['81c7b45e-e1b0-4be7-a755-fa04d0791224'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:07:21 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Volume volume-ad19e43e-910c-44da-b384-4c81f081e81e (ad19e43e-910c-44da-b384-4c81f081e81e): created successfully Sep 01 12:07:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36064dda-1e8c-4b68-bbbf-906f1162e9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:07:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Flow 'volume_create_manager' (30ac9555-314f-4bd4-a4ce-c7d7e6ec97c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:07:21 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-037a27c8-08b6-4cf6-b668-147dd8a90153 tempest-AttachVolumeTestJSON-1344929934 None] Created volume successfully. Sep 01 12:07:21 devstack cinder-volume[87084]: WARNING cinder.quota [None req-37c9fb8e-3b95-4d3f-ac68-a89847da202b tempest-GroupSnapshotsTest-411555266 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-582899096 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-582899096, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:07:21 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-37c9fb8e-3b95-4d3f-ac68-a89847da202b tempest-GroupSnapshotsTest-411555266 None] Created reservations ['c0772820-b74f-44dc-936f-5288aa0e878c', 'f4d4fdde-2018-45f8-b24a-614d03d1761f', '35469ff5-9e38-486d-8034-c71182f13a32', 'f90c6f08-db01-40da-b659-cfc59760fdf3'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:07:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-37c9fb8e-3b95-4d3f-ac68-a89847da202b tempest-GroupSnapshotsTest-411555266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:07:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-37c9fb8e-3b95-4d3f-ac68-a89847da202b tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:07:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-37c9fb8e-3b95-4d3f-ac68-a89847da202b tempest-GroupSnapshotsTest-411555266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:07:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-37c9fb8e-3b95-4d3f-ac68-a89847da202b tempest-GroupSnapshotsTest-411555266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:07:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-37c9fb8e-3b95-4d3f-ac68-a89847da202b tempest-GroupSnapshotsTest-411555266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:07:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37c9fb8e-3b95-4d3f-ac68-a89847da202b tempest-GroupSnapshotsTest-411555266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:21 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:07:21 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:21 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37c9fb8e-3b95-4d3f-ac68-a89847da202b tempest-GroupSnapshotsTest-411555266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.262s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:22 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-37c9fb8e-3b95-4d3f-ac68-a89847da202b tempest-GroupSnapshotsTest-411555266 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:07:22 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-37c9fb8e-3b95-4d3f-ac68-a89847da202b tempest-GroupSnapshotsTest-411555266 None] Delete group completed successfully. Sep 01 12:07:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-9b4019f4-b8aa-4213-8be4-ab2922934f85 req-88fbb7a1-ead3-4302-b19c-7d09a8b5a15d tempest-AttachVolumeTestJSON-1344929934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:07:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-9b4019f4-b8aa-4213-8be4-ab2922934f85 req-88fbb7a1-ead3-4302-b19c-7d09a8b5a15d tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:07:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-9b4019f4-b8aa-4213-8be4-ab2922934f85 req-88fbb7a1-ead3-4302-b19c-7d09a8b5a15d tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:07:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-9b4019f4-b8aa-4213-8be4-ab2922934f85 req-88fbb7a1-ead3-4302-b19c-7d09a8b5a15d tempest-AttachVolumeTestJSON-1344929934 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-ad19e43e-910c-44da-b384-4c81f081e81e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08ba2c20-9227-42ad-9677-aea35417e7a7', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:07:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-9b4019f4-b8aa-4213-8be4-ab2922934f85 req-88fbb7a1-ead3-4302-b19c-7d09a8b5a15d tempest-AttachVolumeTestJSON-1344929934 None] attachment_update completed successfully. Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Flow 'volume_create_manager' (8f8167aa-1458-468e-9c10-5d7c0b27062d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5c9339-7c8c-4287-9547-ecd1dca85906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5c9339-7c8c-4287-9547-ecd1dca85906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1933365815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ea7f04-f35d-4418-8c19-41c61d86b9d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ee30187c9a42728d00d3e0dce96ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:07:28Z,use_quota=True,user_id='cfaf3df4e0994edf8f0aca78655eaa89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8b3442-b774-47d5-8df2-9fbf0eeb5398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8b3442-b774-47d5-8df2-9fbf0eeb5398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02177a7a-dc54-4b2b-8dc0-c749ae16ac63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02177a7a-dc54-4b2b-8dc0-c749ae16ac63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2ea7f04-f35d-4418-8c19-41c61d86b9d8', 'volume_name': 'volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5227730-8ff9-4e65-b8cc-39851560b841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5227730-8ff9-4e65-b8cc-39851560b841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f0b3e9-2b0e-4579-81ff-aa7595cd2d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:07:28 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Volume b2ea7f04-f35d-4418-8c19-41c61d86b9d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8', 'volume_size': 1} Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1933365815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ea7f04-f35d-4418-8c19-41c61d86b9d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ee30187c9a42728d00d3e0dce96ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:07:28Z,use_quota=True,user_id='cfaf3df4e0994edf8f0aca78655eaa89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Creating volume b2ea7f04-f35d-4418-8c19-41c61d86b9d8 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:07:28 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:07:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:28 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8 1073741824 Sep 01 12:07:28 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:29 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8 1073741824" returned: 0 in 0.563s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:29 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8 Sep 01 12:07:29 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:29 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" returned: 0 in 0.446s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:07:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:07:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f0b3e9-2b0e-4579-81ff-aa7595cd2d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:07:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f317a86-c93a-4cf3-9b98-500f6a16e32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:07:29 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Volume volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8 (b2ea7f04-f35d-4418-8c19-41c61d86b9d8): created successfully Sep 01 12:07:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f317a86-c93a-4cf3-9b98-500f6a16e32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:07:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Flow 'volume_create_manager' (8f8167aa-1458-468e-9c10-5d7c0b27062d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:07:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a3ee2e0c-d279-4214-9591-44f5b13b935b tempest-SnapshotsActionsTest-1782740060 None] Created volume successfully. Sep 01 12:07:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-cca1b818-2f20-4bbe-9900-8cb6c52d4607 tempest-SnapshotsActionsTest-1782740060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:07:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-cca1b818-2f20-4bbe-9900-8cb6c52d4607 tempest-SnapshotsActionsTest-1782740060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:07:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-cca1b818-2f20-4bbe-9900-8cb6c52d4607 tempest-SnapshotsActionsTest-1782740060 None] Creating offline snapshot 8ccd4c08-fc83-4fc1-98de-355e0ef0465a of volume b2ea7f04-f35d-4418-8c19-41c61d86b9d8 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:07:30 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbc6fe5-4f5f-43f4-8fca-c6a4de5c8781]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cca1b818-2f20-4bbe-9900-8cb6c52d4607 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:31 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8 Sep 01 12:07:31 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:31 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cca1b818-2f20-4bbe-9900-8cb6c52d4607 tempest-SnapshotsActionsTest-1782740060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" returned: 0 in 0.715s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cca1b818-2f20-4bbe-9900-8cb6c52d4607 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:31 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a 1G Sep 01 12:07:31 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:32 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cca1b818-2f20-4bbe-9900-8cb6c52d4607 tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a 1G" returned: 0 in 0.576s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cca1b818-2f20-4bbe-9900-8cb6c52d4607 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:32 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a Sep 01 12:07:32 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:32 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cca1b818-2f20-4bbe-9900-8cb6c52d4607 tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a" returned: 0 in 0.478s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:32 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-cca1b818-2f20-4bbe-9900-8cb6c52d4607 tempest-SnapshotsActionsTest-1782740060 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a is being set with open permissions: ugo+rw Sep 01 12:07:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cca1b818-2f20-4bbe-9900-8cb6c52d4607 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:32 devstack sudo[91094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a Sep 01 12:07:32 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:32 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cca1b818-2f20-4bbe-9900-8cb6c52d4607 tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a" returned: 0 in 0.345s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cca1b818-2f20-4bbe-9900-8cb6c52d4607 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:33 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.info Sep 01 12:07:33 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:33 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cca1b818-2f20-4bbe-9900-8cb6c52d4607 tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.info" returned: 0 in 0.323s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:33 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-cca1b818-2f20-4bbe-9900-8cb6c52d4607 tempest-SnapshotsActionsTest-1782740060 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.info is being set with open permissions: ugo+rw Sep 01 12:07:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cca1b818-2f20-4bbe-9900-8cb6c52d4607 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:33 devstack sudo[91100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.info Sep 01 12:07:33 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:33 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cca1b818-2f20-4bbe-9900-8cb6c52d4607 tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.info" returned: 0 in 0.373s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-cca1b818-2f20-4bbe-9900-8cb6c52d4607 tempest-SnapshotsActionsTest-1782740060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.949s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:07:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-cca1b818-2f20-4bbe-9900-8cb6c52d4607 tempest-SnapshotsActionsTest-1782740060 None] Create snapshot completed successfully Sep 01 12:07:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-50497f64-d97b-4a88-8f57-d563fe8d34b0 tempest-SnapshotsActionsTest-1782740060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:07:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-50497f64-d97b-4a88-8f57-d563fe8d34b0 tempest-SnapshotsActionsTest-1782740060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:07:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-50497f64-d97b-4a88-8f57-d563fe8d34b0 tempest-SnapshotsActionsTest-1782740060 None] Creating offline snapshot fff94f98-d5e2-4c8b-8777-46032b272722 of volume b2ea7f04-f35d-4418-8c19-41c61d86b9d8 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:07:35 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0fd849-5a68-4680-8f58-c893e8899bf4]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-50497f64-d97b-4a88-8f57-d563fe8d34b0 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:35 devstack sudo[91123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a Sep 01 12:07:35 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:35 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-50497f64-d97b-4a88-8f57-d563fe8d34b0 tempest-SnapshotsActionsTest-1782740060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a" returned: 0 in 0.810s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-50497f64-d97b-4a88-8f57-d563fe8d34b0 tempest-SnapshotsActionsTest-1782740060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:07:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-50497f64-d97b-4a88-8f57-d563fe8d34b0 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.fff94f98-d5e2-4c8b-8777-46032b272722 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:36 devstack sudo[91155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.fff94f98-d5e2-4c8b-8777-46032b272722 1G Sep 01 12:07:36 devstack sudo[91155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:36 devstack sudo[91155]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-50497f64-d97b-4a88-8f57-d563fe8d34b0 tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.fff94f98-d5e2-4c8b-8777-46032b272722 1G" returned: 0 in 0.666s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-50497f64-d97b-4a88-8f57-d563fe8d34b0 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.fff94f98-d5e2-4c8b-8777-46032b272722 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:36 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.fff94f98-d5e2-4c8b-8777-46032b272722 Sep 01 12:07:36 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:36 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-50497f64-d97b-4a88-8f57-d563fe8d34b0 tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.fff94f98-d5e2-4c8b-8777-46032b272722" returned: 0 in 0.367s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:37 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-50497f64-d97b-4a88-8f57-d563fe8d34b0 tempest-SnapshotsActionsTest-1782740060 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.fff94f98-d5e2-4c8b-8777-46032b272722 is being set with open permissions: ugo+rw Sep 01 12:07:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-50497f64-d97b-4a88-8f57-d563fe8d34b0 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.fff94f98-d5e2-4c8b-8777-46032b272722 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:37 devstack sudo[91179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.fff94f98-d5e2-4c8b-8777-46032b272722 Sep 01 12:07:37 devstack sudo[91179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:37 devstack sudo[91179]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-50497f64-d97b-4a88-8f57-d563fe8d34b0 tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.fff94f98-d5e2-4c8b-8777-46032b272722" returned: 0 in 0.357s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-50497f64-d97b-4a88-8f57-d563fe8d34b0 tempest-SnapshotsActionsTest-1782740060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.475s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:07:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-50497f64-d97b-4a88-8f57-d563fe8d34b0 tempest-SnapshotsActionsTest-1782740060 None] Create snapshot completed successfully Sep 01 12:07:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-e2ee5413-d53a-471d-84aa-98f472fe4156 req-fc1fc456-a143-4373-af66-f45b08ac9f1a tempest-TaggedAttachmentsTest-1487015619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:07:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-e2ee5413-d53a-471d-84aa-98f472fe4156 req-fc1fc456-a143-4373-af66-f45b08ac9f1a tempest-TaggedAttachmentsTest-1487015619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:07:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-e2ee5413-d53a-471d-84aa-98f472fe4156 req-fc1fc456-a143-4373-af66-f45b08ac9f1a tempest-TaggedAttachmentsTest-1487015619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:07:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-e2ee5413-d53a-471d-84aa-98f472fe4156 req-fc1fc456-a143-4373-af66-f45b08ac9f1a tempest-TaggedAttachmentsTest-1487015619 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-ea5f572b-8860-43b2-971c-602ffb344b10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bce9a852-ae63-45d4-8cc4-ebf6aeeaff24', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:07:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-e2ee5413-d53a-471d-84aa-98f472fe4156 req-fc1fc456-a143-4373-af66-f45b08ac9f1a tempest-TaggedAttachmentsTest-1487015619 None] attachment_update completed successfully. Sep 01 12:07:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] Acquiring lock "cinder-fff94f98-d5e2-4c8b-8777-46032b272722-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:07:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-fff94f98-d5e2-4c8b-8777-46032b272722-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:07:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] Acquiring lock "cinder-quobyte-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:07:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-quobyte-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:07:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] Acquiring lock "cinder-quobyte-fff94f98-d5e2-4c8b-8777-46032b272722" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:07:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-quobyte-fff94f98-d5e2-4c8b-8777-46032b272722" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:07:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] Deleting offline snapshot fff94f98-d5e2-4c8b-8777-46032b272722 of volume b2ea7f04-f35d-4418-8c19-41c61d86b9d8 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:07:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] snapshot_file for this snap is: volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.fff94f98-d5e2-4c8b-8777-46032b272722 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:07:38 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cc1af3-1aac-4129-9375-279aebeccdd6]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.fff94f98-d5e2-4c8b-8777-46032b272722 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:38 devstack sudo[91201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.fff94f98-d5e2-4c8b-8777-46032b272722 Sep 01 12:07:38 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-c2201768-4f02-44fe-9c8a-a9d0bd04a05b req-2d4534f8-79ff-458c-963c-b1c81999bade tempest-ServerActionsTestOtherA-1571640185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:07:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-c2201768-4f02-44fe-9c8a-a9d0bd04a05b req-2d4534f8-79ff-458c-963c-b1c81999bade tempest-ServerActionsTestOtherA-1571640185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:07:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-c2201768-4f02-44fe-9c8a-a9d0bd04a05b req-2d4534f8-79ff-458c-963c-b1c81999bade tempest-ServerActionsTestOtherA-1571640185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:07:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-c2201768-4f02-44fe-9c8a-a9d0bd04a05b req-2d4534f8-79ff-458c-963c-b1c81999bade tempest-ServerActionsTestOtherA-1571640185 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-95307a56-7b23-44f6-927d-e098de01f204', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b92f2101-c582-4431-a399-f98ee4fccac3', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:07:38 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-c2201768-4f02-44fe-9c8a-a9d0bd04a05b req-2d4534f8-79ff-458c-963c-b1c81999bade tempest-ServerActionsTestOtherA-1571640185 None] attachment_update completed successfully. Sep 01 12:07:38 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.fff94f98-d5e2-4c8b-8777-46032b272722" returned: 0 in 0.467s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:07:39 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccec24f-5137-4640-a8ca-a25c79d19b2c]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:39 devstack sudo[91218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a Sep 01 12:07:39 devstack sudo[91218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:39 devstack sudo[91218]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a" returned: 0 in 0.626s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:07:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.fff94f98-d5e2-4c8b-8777-46032b272722 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:39 devstack sudo[91225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.fff94f98-d5e2-4c8b-8777-46032b272722 Sep 01 12:07:39 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:40 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.fff94f98-d5e2-4c8b-8777-46032b272722" returned: 0 in 0.465s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.fff94f98-d5e2-4c8b-8777-46032b272722 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:40 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.fff94f98-d5e2-4c8b-8777-46032b272722 Sep 01 12:07:40 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:40 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-4a8c137e-cca8-4e47-80d5-9a65e1f560c8 req-c8eb2dc2-985c-4d87-a4de-f8de227dfdad tempest-TaggedAttachmentsTest-1487015619 None] Terminate volume connection completed successfully. Sep 01 12:07:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-4a8c137e-cca8-4e47-80d5-9a65e1f560c8 req-c8eb2dc2-985c-4d87-a4de-f8de227dfdad tempest-TaggedAttachmentsTest-1487015619 None] Deleting attachment bce9a852-ae63-45d4-8cc4-ebf6aeeaff24. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:07:40 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.fff94f98-d5e2-4c8b-8777-46032b272722" returned: 0 in 0.293s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-quobyte-fff94f98-d5e2-4c8b-8777-46032b272722" released by "_delete_snapshot" :: held 2.043s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:07:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-quobyte-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" released by "delete_snapshot" :: held 2.081s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:07:40 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] Created reservations ['0bf13d56-155a-468d-851d-b1d9d03b8120', '0a6a0279-a275-4250-9302-c412f770c9c1', '2c3e012c-84df-473a-b632-d7f0a86f7d69', '77b7a3c6-8363-4160-a4eb-0d3392a53525'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:07:40 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] Delete snapshot completed successfully. Sep 01 12:07:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ba7d15dc-846a-4275-afbd-68f39121e131 tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-fff94f98-d5e2-4c8b-8777-46032b272722-delete_snapshot" released by "delete_snapshot" :: held 2.287s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:07:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:07:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:07:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:07:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:07:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:07:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:07:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:41 devstack sudo[91255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:07:41 devstack sudo[91255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:42 devstack sudo[91255]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.545s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:07:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-91612719-ff35-4b68-92ee-fd9b58666120 tempest-SnapshotsActionsTest-1782740060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:07:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-91612719-ff35-4b68-92ee-fd9b58666120 tempest-SnapshotsActionsTest-1782740060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:07:42 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:07:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 8 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:07:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:07:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-91612719-ff35-4b68-92ee-fd9b58666120 tempest-SnapshotsActionsTest-1782740060 None] Creating offline snapshot 4654f9f3-252a-40c7-9e32-a49b24ecbc02 of volume b2ea7f04-f35d-4418-8c19-41c61d86b9d8 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:07:42 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab642d5-cdb9-424c-ab29-09473fb8f776]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-91612719-ff35-4b68-92ee-fd9b58666120 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:42 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a Sep 01 12:07:42 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:43 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-91612719-ff35-4b68-92ee-fd9b58666120 tempest-SnapshotsActionsTest-1782740060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a" returned: 0 in 0.666s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-91612719-ff35-4b68-92ee-fd9b58666120 tempest-SnapshotsActionsTest-1782740060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:07:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-91612719-ff35-4b68-92ee-fd9b58666120 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.4654f9f3-252a-40c7-9e32-a49b24ecbc02 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:43 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.4654f9f3-252a-40c7-9e32-a49b24ecbc02 1G Sep 01 12:07:43 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-9b553028-3000-48df-87d4-9c0762d3011f req-5f86f170-f2cc-4d4e-9c28-370b3159de73 tempest-ServerActionsTestOtherA-1571640185 None] Terminate volume connection completed successfully. Sep 01 12:07:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-9b553028-3000-48df-87d4-9c0762d3011f req-5f86f170-f2cc-4d4e-9c28-370b3159de73 tempest-ServerActionsTestOtherA-1571640185 None] Deleting attachment b92f2101-c582-4431-a399-f98ee4fccac3. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:07:43 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-91612719-ff35-4b68-92ee-fd9b58666120 tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.4654f9f3-252a-40c7-9e32-a49b24ecbc02 1G" returned: 0 in 0.577s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-91612719-ff35-4b68-92ee-fd9b58666120 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.4654f9f3-252a-40c7-9e32-a49b24ecbc02 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:43 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.4654f9f3-252a-40c7-9e32-a49b24ecbc02 Sep 01 12:07:43 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:44 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-91612719-ff35-4b68-92ee-fd9b58666120 tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.4654f9f3-252a-40c7-9e32-a49b24ecbc02" returned: 0 in 0.782s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:44 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-91612719-ff35-4b68-92ee-fd9b58666120 tempest-SnapshotsActionsTest-1782740060 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.4654f9f3-252a-40c7-9e32-a49b24ecbc02 is being set with open permissions: ugo+rw Sep 01 12:07:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-91612719-ff35-4b68-92ee-fd9b58666120 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.4654f9f3-252a-40c7-9e32-a49b24ecbc02 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:44 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.4654f9f3-252a-40c7-9e32-a49b24ecbc02 Sep 01 12:07:44 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:45 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-91612719-ff35-4b68-92ee-fd9b58666120 tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.4654f9f3-252a-40c7-9e32-a49b24ecbc02" returned: 0 in 0.518s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-91612719-ff35-4b68-92ee-fd9b58666120 tempest-SnapshotsActionsTest-1782740060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.778s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:07:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-91612719-ff35-4b68-92ee-fd9b58666120 tempest-SnapshotsActionsTest-1782740060 None] Create snapshot completed successfully Sep 01 12:07:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-9b553028-3000-48df-87d4-9c0762d3011f req-0e215b19-67f8-4103-9fcc-d41ac62a7d78 tempest-ServerActionsTestOtherA-1571640185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:07:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-9b553028-3000-48df-87d4-9c0762d3011f req-0e215b19-67f8-4103-9fcc-d41ac62a7d78 tempest-ServerActionsTestOtherA-1571640185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:07:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-9b553028-3000-48df-87d4-9c0762d3011f req-0e215b19-67f8-4103-9fcc-d41ac62a7d78 tempest-ServerActionsTestOtherA-1571640185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:07:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-9b553028-3000-48df-87d4-9c0762d3011f req-0e215b19-67f8-4103-9fcc-d41ac62a7d78 tempest-ServerActionsTestOtherA-1571640185 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-95307a56-7b23-44f6-927d-e098de01f204', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0f40bfa-b047-4e2e-824d-8a65be3d11ff', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:07:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-9b553028-3000-48df-87d4-9c0762d3011f req-0e215b19-67f8-4103-9fcc-d41ac62a7d78 tempest-ServerActionsTestOtherA-1571640185 None] attachment_update completed successfully. Sep 01 12:07:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] Acquiring lock "cinder-4654f9f3-252a-40c7-9e32-a49b24ecbc02-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:07:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-4654f9f3-252a-40c7-9e32-a49b24ecbc02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:07:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] Acquiring lock "cinder-quobyte-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:07:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-quobyte-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:07:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] Acquiring lock "cinder-quobyte-4654f9f3-252a-40c7-9e32-a49b24ecbc02" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:07:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-quobyte-4654f9f3-252a-40c7-9e32-a49b24ecbc02" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:07:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] Deleting offline snapshot 4654f9f3-252a-40c7-9e32-a49b24ecbc02 of volume b2ea7f04-f35d-4418-8c19-41c61d86b9d8 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:07:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] snapshot_file for this snap is: volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.4654f9f3-252a-40c7-9e32-a49b24ecbc02 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:07:45 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f70addd-aedb-4688-8d6d-d3b4fe3ca376]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.4654f9f3-252a-40c7-9e32-a49b24ecbc02 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:45 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.4654f9f3-252a-40c7-9e32-a49b24ecbc02 Sep 01 12:07:45 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:46 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.4654f9f3-252a-40c7-9e32-a49b24ecbc02" returned: 0 in 0.744s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:07:46 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5729f3-d98e-492e-bd19-dc12d8ca7c92]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:46 devstack sudo[91368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a Sep 01 12:07:46 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:47 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a" returned: 0 in 0.680s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:07:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.4654f9f3-252a-40c7-9e32-a49b24ecbc02 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:47 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.4654f9f3-252a-40c7-9e32-a49b24ecbc02 Sep 01 12:07:47 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:47 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.4654f9f3-252a-40c7-9e32-a49b24ecbc02" returned: 0 in 0.641s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.4654f9f3-252a-40c7-9e32-a49b24ecbc02 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:47 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.4654f9f3-252a-40c7-9e32-a49b24ecbc02 Sep 01 12:07:47 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:48 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.4654f9f3-252a-40c7-9e32-a49b24ecbc02" returned: 0 in 0.292s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-quobyte-4654f9f3-252a-40c7-9e32-a49b24ecbc02" released by "_delete_snapshot" :: held 2.522s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:07:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-quobyte-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" released by "delete_snapshot" :: held 2.563s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:07:48 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=106,cinder:UPDATE=70,cinder:DELETE=5,cinder:INSERT=18 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:07:48 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] Created reservations ['e9b996e1-50bf-4df5-a447-75aaae44a3f6', '6ea909d2-6fe0-428b-97af-b5fee38f1ab2', '7e99dfea-c1a7-40f2-b40d-96574bafc0a9', '1964cfc4-4afc-4e71-a088-280be3b77e53'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:07:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] Delete snapshot completed successfully. Sep 01 12:07:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-fed1acab-afc4-4efe-9535-8e7590094102 tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-4654f9f3-252a-40c7-9e32-a49b24ecbc02-delete_snapshot" released by "delete_snapshot" :: held 2.754s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:07:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2a366ecc-f8b3-472a-8a07-d48fb72c62f9 tempest-SnapshotsActionsTest-1782740060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:07:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2a366ecc-f8b3-472a-8a07-d48fb72c62f9 tempest-SnapshotsActionsTest-1782740060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:07:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2a366ecc-f8b3-472a-8a07-d48fb72c62f9 tempest-SnapshotsActionsTest-1782740060 None] Creating offline snapshot 9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f of volume b2ea7f04-f35d-4418-8c19-41c61d86b9d8 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:07:49 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ee81fd-7a36-4e7e-af58-935ecd103ae0]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2a366ecc-f8b3-472a-8a07-d48fb72c62f9 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:49 devstack sudo[91460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a Sep 01 12:07:49 devstack sudo[91460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:50 devstack sudo[91460]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2a366ecc-f8b3-472a-8a07-d48fb72c62f9 tempest-SnapshotsActionsTest-1782740060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a" returned: 0 in 0.405s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2a366ecc-f8b3-472a-8a07-d48fb72c62f9 tempest-SnapshotsActionsTest-1782740060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:07:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2a366ecc-f8b3-472a-8a07-d48fb72c62f9 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:50 devstack sudo[91468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f 1G Sep 01 12:07:50 devstack sudo[91468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:50 devstack sudo[91468]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2a366ecc-f8b3-472a-8a07-d48fb72c62f9 tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f 1G" returned: 0 in 0.644s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2a366ecc-f8b3-472a-8a07-d48fb72c62f9 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:50 devstack sudo[91477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f Sep 01 12:07:50 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:51 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2a366ecc-f8b3-472a-8a07-d48fb72c62f9 tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f" returned: 0 in 0.443s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:51 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-2a366ecc-f8b3-472a-8a07-d48fb72c62f9 tempest-SnapshotsActionsTest-1782740060 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f is being set with open permissions: ugo+rw Sep 01 12:07:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2a366ecc-f8b3-472a-8a07-d48fb72c62f9 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:51 devstack sudo[91483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f Sep 01 12:07:51 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:51 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2a366ecc-f8b3-472a-8a07-d48fb72c62f9 tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f" returned: 0 in 0.296s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:51 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=110,cinder:UPDATE=98,cinder:INSERT=22,cinder:DELETE=2 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:07:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2a366ecc-f8b3-472a-8a07-d48fb72c62f9 tempest-SnapshotsActionsTest-1782740060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.925s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:07:51 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2a366ecc-f8b3-472a-8a07-d48fb72c62f9 tempest-SnapshotsActionsTest-1782740060 None] Create snapshot completed successfully Sep 01 12:07:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] Acquiring lock "cinder-9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:07:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:07:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] Acquiring lock "cinder-quobyte-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:07:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-quobyte-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:07:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] Acquiring lock "cinder-quobyte-9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:07:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-quobyte-9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:07:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] Deleting offline snapshot 9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f of volume b2ea7f04-f35d-4418-8c19-41c61d86b9d8 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:07:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] snapshot_file for this snap is: volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:07:51 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1882aff-0c25-4cdf-9f43-7f2a7f8d5508]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:52 devstack sudo[91487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f Sep 01 12:07:52 devstack sudo[91487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-db1749bf-1274-4bb8-a7ee-94edaf4c5340 tempest-TaggedAttachmentsTest-1487015619 None] Acquiring lock "cinder-ea5f572b-8860-43b2-971c-602ffb344b10-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:07:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-db1749bf-1274-4bb8-a7ee-94edaf4c5340 tempest-TaggedAttachmentsTest-1487015619 None] Lock "cinder-ea5f572b-8860-43b2-971c-602ffb344b10-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:07:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-db1749bf-1274-4bb8-a7ee-94edaf4c5340 tempest-TaggedAttachmentsTest-1487015619 None] Acquiring lock "cinder-quobyte-ea5f572b-8860-43b2-971c-602ffb344b10" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:07:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-db1749bf-1274-4bb8-a7ee-94edaf4c5340 tempest-TaggedAttachmentsTest-1487015619 None] Lock "cinder-quobyte-ea5f572b-8860-43b2-971c-602ffb344b10" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:07:52 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4916a21a-2bdf-4ede-9c1c-b707ee8ace47]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db1749bf-1274-4bb8-a7ee-94edaf4c5340 tempest-TaggedAttachmentsTest-1487015619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ea5f572b-8860-43b2-971c-602ffb344b10 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:52 devstack sudo[91487]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f" returned: 0 in 0.571s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:07:52 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f71ecdf-dbcd-486a-a088-3de432f76499]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:52 devstack sudo[91492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ea5f572b-8860-43b2-971c-602ffb344b10 Sep 01 12:07:52 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:52 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a Sep 01 12:07:52 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:52 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db1749bf-1274-4bb8-a7ee-94edaf4c5340 tempest-TaggedAttachmentsTest-1487015619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ea5f572b-8860-43b2-971c-602ffb344b10" returned: 0 in 0.479s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db1749bf-1274-4bb8-a7ee-94edaf4c5340 tempest-TaggedAttachmentsTest-1487015619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ea5f572b-8860-43b2-971c-602ffb344b10 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:53 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a" returned: 0 in 0.449s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:07:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:53 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ea5f572b-8860-43b2-971c-602ffb344b10 Sep 01 12:07:53 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:53 devstack sudo[91505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f Sep 01 12:07:53 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:53 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db1749bf-1274-4bb8-a7ee-94edaf4c5340 tempest-TaggedAttachmentsTest-1487015619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ea5f572b-8860-43b2-971c-602ffb344b10" returned: 0 in 0.258s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-db1749bf-1274-4bb8-a7ee-94edaf4c5340 tempest-TaggedAttachmentsTest-1487015619 None] Lock "cinder-quobyte-ea5f572b-8860-43b2-971c-602ffb344b10" released by "delete_volume" :: held 0.789s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:07:53 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-db1749bf-1274-4bb8-a7ee-94edaf4c5340 tempest-TaggedAttachmentsTest-1487015619 None] Created reservations ['4243ce6f-f821-40bc-af30-cd36cce83220', '32cbd7a8-9434-4d1e-9c53-b728fedb6480', '36a4b5c3-fc72-4ede-a9ae-7051f93e8ade', 'c8fb32a2-c325-4816-98d8-3589b5af56ed'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:07:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-db1749bf-1274-4bb8-a7ee-94edaf4c5340 tempest-TaggedAttachmentsTest-1487015619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:07:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-db1749bf-1274-4bb8-a7ee-94edaf4c5340 tempest-TaggedAttachmentsTest-1487015619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:07:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-db1749bf-1274-4bb8-a7ee-94edaf4c5340 tempest-TaggedAttachmentsTest-1487015619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:07:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-db1749bf-1274-4bb8-a7ee-94edaf4c5340 tempest-TaggedAttachmentsTest-1487015619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:07:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-db1749bf-1274-4bb8-a7ee-94edaf4c5340 tempest-TaggedAttachmentsTest-1487015619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:07:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db1749bf-1274-4bb8-a7ee-94edaf4c5340 tempest-TaggedAttachmentsTest-1487015619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:53 devstack sudo[91512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:07:53 devstack sudo[91512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:53 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f" returned: 0 in 0.481s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:53 devstack sudo[91514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f Sep 01 12:07:53 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:53 devstack sudo[91512]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db1749bf-1274-4bb8-a7ee-94edaf4c5340 tempest-TaggedAttachmentsTest-1487015619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.383s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-db1749bf-1274-4bb8-a7ee-94edaf4c5340 tempest-TaggedAttachmentsTest-1487015619 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:07:53 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-db1749bf-1274-4bb8-a7ee-94edaf4c5340 tempest-TaggedAttachmentsTest-1487015619 None] Deleted volume successfully. Sep 01 12:07:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-db1749bf-1274-4bb8-a7ee-94edaf4c5340 tempest-TaggedAttachmentsTest-1487015619 None] Lock "cinder-ea5f572b-8860-43b2-971c-602ffb344b10-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:07:53 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f" returned: 0 in 0.421s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-quobyte-9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f" released by "_delete_snapshot" :: held 2.069s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:07:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-quobyte-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" released by "delete_snapshot" :: held 2.102s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:07:54 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] Created reservations ['9a0560bd-58a0-4ffd-a914-2c1d8768eab8', 'c5dbc230-a47f-40e7-88c2-6fbb6fead3ae', 'ce5fad9c-effc-4c62-a386-11ada6102fe7', '05008672-08a8-4cd8-bd25-2038d2906bef'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:07:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] Delete snapshot completed successfully. Sep 01 12:07:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5027b71d-2af6-4c93-b8b7-94372df20dc5 tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-9a4edb8c-16a8-466a-8e4a-ac57e10d7f6f-delete_snapshot" released by "delete_snapshot" :: held 2.332s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:07:55 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-d63081e2-d6f2-46f1-9c96-4112c98fb434 req-6b900b57-d25e-4170-8644-a79855fa0812 tempest-AttachVolumeTestJSON-1344929934 None] Terminate volume connection completed successfully. Sep 01 12:07:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-d63081e2-d6f2-46f1-9c96-4112c98fb434 req-6b900b57-d25e-4170-8644-a79855fa0812 tempest-AttachVolumeTestJSON-1344929934 None] Deleting attachment 08ba2c20-9227-42ad-9677-aea35417e7a7. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:07:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c7e5d826-1eee-43a1-a5e0-7e1e5654c2c3 tempest-SnapshotsActionsTest-1782740060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:07:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c7e5d826-1eee-43a1-a5e0-7e1e5654c2c3 tempest-SnapshotsActionsTest-1782740060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:07:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c7e5d826-1eee-43a1-a5e0-7e1e5654c2c3 tempest-SnapshotsActionsTest-1782740060 None] Creating offline snapshot 6553ef0d-dace-49e5-a68e-16c8282d1bbc of volume b2ea7f04-f35d-4418-8c19-41c61d86b9d8 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:07:55 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2d1d5d-053c-47a5-a801-d96919d524f9]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c7e5d826-1eee-43a1-a5e0-7e1e5654c2c3 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:55 devstack sudo[91526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a Sep 01 12:07:55 devstack sudo[91526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:56 devstack sudo[91526]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c7e5d826-1eee-43a1-a5e0-7e1e5654c2c3 tempest-SnapshotsActionsTest-1782740060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a" returned: 0 in 0.723s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c7e5d826-1eee-43a1-a5e0-7e1e5654c2c3 tempest-SnapshotsActionsTest-1782740060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:07:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c7e5d826-1eee-43a1-a5e0-7e1e5654c2c3 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.6553ef0d-dace-49e5-a68e-16c8282d1bbc 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:56 devstack sudo[91537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.6553ef0d-dace-49e5-a68e-16c8282d1bbc 1G Sep 01 12:07:56 devstack sudo[91537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:56 devstack sudo[91537]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c7e5d826-1eee-43a1-a5e0-7e1e5654c2c3 tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.6553ef0d-dace-49e5-a68e-16c8282d1bbc 1G" returned: 0 in 0.465s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c7e5d826-1eee-43a1-a5e0-7e1e5654c2c3 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.6553ef0d-dace-49e5-a68e-16c8282d1bbc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:56 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.6553ef0d-dace-49e5-a68e-16c8282d1bbc Sep 01 12:07:56 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:57 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c7e5d826-1eee-43a1-a5e0-7e1e5654c2c3 tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.6553ef0d-dace-49e5-a68e-16c8282d1bbc" returned: 0 in 0.319s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:57 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-c7e5d826-1eee-43a1-a5e0-7e1e5654c2c3 tempest-SnapshotsActionsTest-1782740060 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.6553ef0d-dace-49e5-a68e-16c8282d1bbc is being set with open permissions: ugo+rw Sep 01 12:07:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c7e5d826-1eee-43a1-a5e0-7e1e5654c2c3 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.6553ef0d-dace-49e5-a68e-16c8282d1bbc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:57 devstack sudo[91549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.6553ef0d-dace-49e5-a68e-16c8282d1bbc Sep 01 12:07:57 devstack sudo[91549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:57 devstack sudo[91549]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c7e5d826-1eee-43a1-a5e0-7e1e5654c2c3 tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.6553ef0d-dace-49e5-a68e-16c8282d1bbc" returned: 0 in 0.251s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c7e5d826-1eee-43a1-a5e0-7e1e5654c2c3 tempest-SnapshotsActionsTest-1782740060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.878s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:07:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c7e5d826-1eee-43a1-a5e0-7e1e5654c2c3 tempest-SnapshotsActionsTest-1782740060 None] Create snapshot completed successfully Sep 01 12:07:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] Acquiring lock "cinder-6553ef0d-dace-49e5-a68e-16c8282d1bbc-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:07:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-6553ef0d-dace-49e5-a68e-16c8282d1bbc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:07:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] Acquiring lock "cinder-quobyte-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:07:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-quobyte-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" acquired by "delete_snapshot" :: waited 0.093s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:07:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] Acquiring lock "cinder-quobyte-6553ef0d-dace-49e5-a68e-16c8282d1bbc" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:07:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-quobyte-6553ef0d-dace-49e5-a68e-16c8282d1bbc" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:07:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] Deleting offline snapshot 6553ef0d-dace-49e5-a68e-16c8282d1bbc of volume b2ea7f04-f35d-4418-8c19-41c61d86b9d8 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:07:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] snapshot_file for this snap is: volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.6553ef0d-dace-49e5-a68e-16c8282d1bbc {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:07:58 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b8638c-a8da-46da-98fd-f76b2644950b]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.6553ef0d-dace-49e5-a68e-16c8282d1bbc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:58 devstack sudo[91561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.6553ef0d-dace-49e5-a68e-16c8282d1bbc Sep 01 12:07:58 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:58 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.6553ef0d-dace-49e5-a68e-16c8282d1bbc" returned: 0 in 0.594s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:07:58 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c83d88e-d98c-4768-8bb2-588726361208]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:07:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:59 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a Sep 01 12:07:59 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:07:59 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Sep 01 12:07:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a" returned: 0 in 0.766s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:07:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:07:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.6553ef0d-dace-49e5-a68e-16c8282d1bbc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:07:59 devstack sudo[91597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.6553ef0d-dace-49e5-a68e-16c8282d1bbc Sep 01 12:07:59 devstack sudo[91597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:00 devstack sudo[91597]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.6553ef0d-dace-49e5-a68e-16c8282d1bbc" returned: 0 in 0.809s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.6553ef0d-dace-49e5-a68e-16c8282d1bbc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:00 devstack sudo[91619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.6553ef0d-dace-49e5-a68e-16c8282d1bbc Sep 01 12:08:00 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:00 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.6553ef0d-dace-49e5-a68e-16c8282d1bbc" returned: 0 in 0.369s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-quobyte-6553ef0d-dace-49e5-a68e-16c8282d1bbc" released by "_delete_snapshot" :: held 2.776s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:08:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-quobyte-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" released by "delete_snapshot" :: held 2.839s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:08:00 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] Created reservations ['fc433c10-6632-4eb1-853d-395f3b3682a9', '1531966e-be21-49a7-a22a-312366000dab', '3fec70df-f52a-4edd-a785-e96967f40edc', 'c69bf20f-8f2b-4d1c-9613-f86c296ce6c9'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:08:01 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] Delete snapshot completed successfully. Sep 01 12:08:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-543e86b5-980f-4f09-8283-c6d494ae541f tempest-SnapshotsActionsTest-535320734 None] Lock "cinder-6553ef0d-dace-49e5-a68e-16c8282d1bbc-delete_snapshot" released by "delete_snapshot" :: held 3.102s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:08:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] Acquiring lock "cinder-8ccd4c08-fc83-4fc1-98de-355e0ef0465a-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:08:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] Lock "cinder-8ccd4c08-fc83-4fc1-98de-355e0ef0465a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:08:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] Acquiring lock "cinder-quobyte-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:08:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] Lock "cinder-quobyte-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:08:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] Acquiring lock "cinder-quobyte-8ccd4c08-fc83-4fc1-98de-355e0ef0465a" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:08:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] Lock "cinder-quobyte-8ccd4c08-fc83-4fc1-98de-355e0ef0465a" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:08:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] Deleting offline snapshot 8ccd4c08-fc83-4fc1-98de-355e0ef0465a of volume b2ea7f04-f35d-4418-8c19-41c61d86b9d8 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:08:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] snapshot_file for this snap is: volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:08:02 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5508905-5f99-46b7-a36b-f5072b50aa56]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:08:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:02 devstack sudo[91711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a Sep 01 12:08:02 devstack sudo[91711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:03 devstack sudo[91711]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a" returned: 0 in 0.711s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:08:03 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8b0881-f5d8-458c-8a7c-a604c0e7f231]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:08:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:03 devstack sudo[91723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8 Sep 01 12:08:03 devstack sudo[91723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:03 devstack sudo[91723]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" returned: 0 in 0.418s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:03 devstack sudo[91730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a Sep 01 12:08:03 devstack sudo[91730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:04 devstack sudo[91730]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a" returned: 0 in 0.435s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:04 devstack sudo[91736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a Sep 01 12:08:04 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:04 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8.8ccd4c08-fc83-4fc1-98de-355e0ef0465a" returned: 0 in 0.289s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] Lock "cinder-quobyte-8ccd4c08-fc83-4fc1-98de-355e0ef0465a" released by "_delete_snapshot" :: held 1.997s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:08:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] Lock "cinder-quobyte-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" released by "delete_snapshot" :: held 2.042s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:08:04 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] Created reservations ['532a284c-23b1-4304-8f55-48561b397126', '69802357-48d5-424a-a612-1b0eb64f92f2', '835a2bb9-8d83-4f34-a66b-4d35a5e60351', 'e013e944-99b5-4827-a85b-b277302e8fce'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:08:04 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] Delete snapshot completed successfully. Sep 01 12:08:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1c2d03a8-ea15-493b-85bf-0e736e75240c tempest-SnapshotsActionsTest-1782740060 None] Lock "cinder-8ccd4c08-fc83-4fc1-98de-355e0ef0465a-delete_snapshot" released by "delete_snapshot" :: held 2.193s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:08:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-40db2a40-b0b2-4696-a7e4-3ca1df6f5c38 tempest-SnapshotsActionsTest-1782740060 None] Acquiring lock "cinder-b2ea7f04-f35d-4418-8c19-41c61d86b9d8-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:08:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-40db2a40-b0b2-4696-a7e4-3ca1df6f5c38 tempest-SnapshotsActionsTest-1782740060 None] Lock "cinder-b2ea7f04-f35d-4418-8c19-41c61d86b9d8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:08:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-40db2a40-b0b2-4696-a7e4-3ca1df6f5c38 tempest-SnapshotsActionsTest-1782740060 None] Acquiring lock "cinder-quobyte-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:08:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-40db2a40-b0b2-4696-a7e4-3ca1df6f5c38 tempest-SnapshotsActionsTest-1782740060 None] Lock "cinder-quobyte-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:08:05 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea54f37-5130-4ee4-a1cd-955d60a726a2]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:08:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-40db2a40-b0b2-4696-a7e4-3ca1df6f5c38 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:06 devstack sudo[91740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8 Sep 01 12:08:06 devstack sudo[91740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:06 devstack sudo[91740]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-40db2a40-b0b2-4696-a7e4-3ca1df6f5c38 tempest-SnapshotsActionsTest-1782740060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" returned: 0 in 0.448s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-40db2a40-b0b2-4696-a7e4-3ca1df6f5c38 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:06 devstack sudo[91746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8 Sep 01 12:08:06 devstack sudo[91746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:06 devstack sudo[91746]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-40db2a40-b0b2-4696-a7e4-3ca1df6f5c38 tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" returned: 0 in 0.271s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-40db2a40-b0b2-4696-a7e4-3ca1df6f5c38 tempest-SnapshotsActionsTest-1782740060 None] Lock "cinder-quobyte-b2ea7f04-f35d-4418-8c19-41c61d86b9d8" released by "delete_volume" :: held 0.775s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:08:06 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-40db2a40-b0b2-4696-a7e4-3ca1df6f5c38 tempest-SnapshotsActionsTest-1782740060 None] Created reservations ['1dc6c6c6-74e8-4d1f-ad54-76390f21ae30', '484ba4e3-1ab7-4be1-966e-9864b3803da3', 'ee5030e9-acd9-4878-9f70-fee864e1e635', '4ba60445-15ae-41ca-9125-3cdb3d55fb0a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:08:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-40db2a40-b0b2-4696-a7e4-3ca1df6f5c38 tempest-SnapshotsActionsTest-1782740060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:08:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-40db2a40-b0b2-4696-a7e4-3ca1df6f5c38 tempest-SnapshotsActionsTest-1782740060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:08:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-40db2a40-b0b2-4696-a7e4-3ca1df6f5c38 tempest-SnapshotsActionsTest-1782740060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:08:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-40db2a40-b0b2-4696-a7e4-3ca1df6f5c38 tempest-SnapshotsActionsTest-1782740060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:08:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-40db2a40-b0b2-4696-a7e4-3ca1df6f5c38 tempest-SnapshotsActionsTest-1782740060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:08:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-40db2a40-b0b2-4696-a7e4-3ca1df6f5c38 tempest-SnapshotsActionsTest-1782740060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:06 devstack sudo[91749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:08:06 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:07 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-40db2a40-b0b2-4696-a7e4-3ca1df6f5c38 tempest-SnapshotsActionsTest-1782740060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.293s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:07 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-40db2a40-b0b2-4696-a7e4-3ca1df6f5c38 tempest-SnapshotsActionsTest-1782740060 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:08:07 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-40db2a40-b0b2-4696-a7e4-3ca1df6f5c38 tempest-SnapshotsActionsTest-1782740060 None] Deleted volume successfully. Sep 01 12:08:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-40db2a40-b0b2-4696-a7e4-3ca1df6f5c38 tempest-SnapshotsActionsTest-1782740060 None] Lock "cinder-b2ea7f04-f35d-4418-8c19-41c61d86b9d8-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:08:12 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-16d55222-12ed-43e9-ad0e-f70cd93dd54d req-127e0455-fbae-439f-871a-81145e1259f7 tempest-ServerActionsTestOtherA-1571640185 None] Terminate volume connection completed successfully. Sep 01 12:08:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-16d55222-12ed-43e9-ad0e-f70cd93dd54d req-127e0455-fbae-439f-871a-81145e1259f7 tempest-ServerActionsTestOtherA-1571640185 None] Deleting attachment f0f40bfa-b047-4e2e-824d-8a65be3d11ff. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Flow 'volume_create_manager' (0350924a-ccf5-4e69-82e2-cd0acdf2e291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414faedd-4a1b-4643-92d6-1ba530ef03d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414faedd-4a1b-4643-92d6-1ba530ef03d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1327328479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b2b89c-8597-4928-94b3-2dfc40451fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5793c08bd1ff4b9e9d6ad5f503e2ea73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:08:14Z,use_quota=True,user_id='9cdfd6ee1d9b4da2ab2d9e340c86fa77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6afa899a-aa24-4df0-81c7-7aa6b7e3c7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6afa899a-aa24-4df0-81c7-7aa6b7e3c7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d584c231-e604-4035-8eed-3920cb3e749a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d584c231-e604-4035-8eed-3920cb3e749a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31b2b89c-8597-4928-94b3-2dfc40451fea', 'volume_name': 'volume-31b2b89c-8597-4928-94b3-2dfc40451fea', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62dfc77-333e-4c2a-a292-6085939f5cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62dfc77-333e-4c2a-a292-6085939f5cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3805268d-a003-4ec2-ad94-bdf3b7c78d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:08:14 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Volume 31b2b89c-8597-4928-94b3-2dfc40451fea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31b2b89c-8597-4928-94b3-2dfc40451fea', 'volume_size': 1} Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1327328479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b2b89c-8597-4928-94b3-2dfc40451fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5793c08bd1ff4b9e9d6ad5f503e2ea73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:08:14Z,use_quota=True,user_id='9cdfd6ee1d9b4da2ab2d9e340c86fa77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Creating volume 31b2b89c-8597-4928-94b3-2dfc40451fea {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:08:14 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:08:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-31b2b89c-8597-4928-94b3-2dfc40451fea 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:14 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-31b2b89c-8597-4928-94b3-2dfc40451fea 1073741824 Sep 01 12:08:14 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:15 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-31b2b89c-8597-4928-94b3-2dfc40451fea 1073741824" returned: 0 in 0.639s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-31b2b89c-8597-4928-94b3-2dfc40451fea {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:15 devstack sudo[91807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-31b2b89c-8597-4928-94b3-2dfc40451fea Sep 01 12:08:15 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:15 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-31b2b89c-8597-4928-94b3-2dfc40451fea" returned: 0 in 0.477s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:08:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:08:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3805268d-a003-4ec2-ad94-bdf3b7c78d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31b2b89c-8597-4928-94b3-2dfc40451fea', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:08:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7712c4-9afa-45ea-99fb-b5222822a19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:08:15 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Volume volume-31b2b89c-8597-4928-94b3-2dfc40451fea (31b2b89c-8597-4928-94b3-2dfc40451fea): created successfully Sep 01 12:08:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7712c4-9afa-45ea-99fb-b5222822a19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:08:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Flow 'volume_create_manager' (0350924a-ccf5-4e69-82e2-cd0acdf2e291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:08:15 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7b39002b-48c8-4ab1-88c2-afe035a65908 tempest-VolumesServicesTestJSON-2114101094 None] Created volume successfully. Sep 01 12:08:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c1610995-e398-43c4-b0d9-85c2984aae58 tempest-VolumesServicesTestJSON-2114101094 None] Acquiring lock "cinder-31b2b89c-8597-4928-94b3-2dfc40451fea-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:08:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c1610995-e398-43c4-b0d9-85c2984aae58 tempest-VolumesServicesTestJSON-2114101094 None] Lock "cinder-31b2b89c-8597-4928-94b3-2dfc40451fea-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:08:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c1610995-e398-43c4-b0d9-85c2984aae58 tempest-VolumesServicesTestJSON-2114101094 None] Acquiring lock "cinder-quobyte-31b2b89c-8597-4928-94b3-2dfc40451fea" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:08:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c1610995-e398-43c4-b0d9-85c2984aae58 tempest-VolumesServicesTestJSON-2114101094 None] Lock "cinder-quobyte-31b2b89c-8597-4928-94b3-2dfc40451fea" acquired by "delete_volume" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:08:16 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0871db13-b087-4d0d-8629-dd554c753166]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:08:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c1610995-e398-43c4-b0d9-85c2984aae58 tempest-VolumesServicesTestJSON-2114101094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-31b2b89c-8597-4928-94b3-2dfc40451fea {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:17 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-31b2b89c-8597-4928-94b3-2dfc40451fea Sep 01 12:08:17 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:17 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c1610995-e398-43c4-b0d9-85c2984aae58 tempest-VolumesServicesTestJSON-2114101094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-31b2b89c-8597-4928-94b3-2dfc40451fea" returned: 0 in 0.397s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c1610995-e398-43c4-b0d9-85c2984aae58 tempest-VolumesServicesTestJSON-2114101094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-31b2b89c-8597-4928-94b3-2dfc40451fea {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:17 devstack sudo[91842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-31b2b89c-8597-4928-94b3-2dfc40451fea Sep 01 12:08:17 devstack sudo[91842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:17 devstack sudo[91842]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c1610995-e398-43c4-b0d9-85c2984aae58 tempest-VolumesServicesTestJSON-2114101094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-31b2b89c-8597-4928-94b3-2dfc40451fea" returned: 0 in 0.260s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c1610995-e398-43c4-b0d9-85c2984aae58 tempest-VolumesServicesTestJSON-2114101094 None] Lock "cinder-quobyte-31b2b89c-8597-4928-94b3-2dfc40451fea" released by "delete_volume" :: held 0.706s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:08:17 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c1610995-e398-43c4-b0d9-85c2984aae58 tempest-VolumesServicesTestJSON-2114101094 None] Created reservations ['ded67222-e516-4c4f-80c8-d17bb4625c41', '493ea0df-03e8-4b71-b7d2-64767b65f1d3', '638b6278-8139-4b40-a725-8847198e9421', '680b72d2-01f7-47c4-8e37-2f509e4cfdcf'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:08:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c1610995-e398-43c4-b0d9-85c2984aae58 tempest-VolumesServicesTestJSON-2114101094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:08:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c1610995-e398-43c4-b0d9-85c2984aae58 tempest-VolumesServicesTestJSON-2114101094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:08:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c1610995-e398-43c4-b0d9-85c2984aae58 tempest-VolumesServicesTestJSON-2114101094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:08:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c1610995-e398-43c4-b0d9-85c2984aae58 tempest-VolumesServicesTestJSON-2114101094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:08:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c1610995-e398-43c4-b0d9-85c2984aae58 tempest-VolumesServicesTestJSON-2114101094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:08:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c1610995-e398-43c4-b0d9-85c2984aae58 tempest-VolumesServicesTestJSON-2114101094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:17 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:08:17 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:18 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c1610995-e398-43c4-b0d9-85c2984aae58 tempest-VolumesServicesTestJSON-2114101094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.389s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:18 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c1610995-e398-43c4-b0d9-85c2984aae58 tempest-VolumesServicesTestJSON-2114101094 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:08:18 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c1610995-e398-43c4-b0d9-85c2984aae58 tempest-VolumesServicesTestJSON-2114101094 None] Deleted volume successfully. Sep 01 12:08:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c1610995-e398-43c4-b0d9-85c2984aae58 tempest-VolumesServicesTestJSON-2114101094 None] Lock "cinder-31b2b89c-8597-4928-94b3-2dfc40451fea-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:08:23 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:08:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Flow 'volume_create_manager' (c67a2058-0a27-43cf-9d49-f90d57fde356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:08:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3b5623-10ca-48e2-8d99-f125d0e15d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:08:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3b5623-10ca-48e2-8d99-f125d0e15d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1251568783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14352247-b51d-46cd-a02c-5a68bdc2ee51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb4a63bc4d84e70a520828f5e25554a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:08:24Z,use_quota=True,user_id='f521a3a6aa2a4de6a561dcd590273e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:08:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d979d98-6c21-44d0-b4b9-849517cc8556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:08:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d979d98-6c21-44d0-b4b9-849517cc8556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:08:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa3ae3d-5d5c-4b0d-ae19-b7b5e6e7a5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:08:23 devstack cinder-volume[87084]: DEBUG cinder.image.glance [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Creating Keystone auth plugin from conf {{(pid=87084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 12:08:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa3ae3d-5d5c-4b0d-ae19-b7b5e6e7a5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '14352247-b51d-46cd-a02c-5a68bdc2ee51', 'volume_name': 'volume-14352247-b51d-46cd-a02c-5a68bdc2ee51', 'volume_size': 1, 'image_id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42fce3cc35724a058187a1135a373ea9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'created_at': datetime.datetime(2026, 9, 1, 9, 59, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 59, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:08:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0278b76-7ea5-4ab9-824c-659aae763981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:08:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0278b76-7ea5-4ab9-824c-659aae763981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:08:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58613a2f-70df-4ea4-b988-6f94f1dff184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:08:24 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Volume 14352247-b51d-46cd-a02c-5a68bdc2ee51: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-14352247-b51d-46cd-a02c-5a68bdc2ee51', 'volume_size': 1, 'image_id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42fce3cc35724a058187a1135a373ea9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'created_at': datetime.datetime(2026, 9, 1, 9, 59, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 59, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 12:08:24 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Trying to clone 14352247-b51d-46cd-a02c-5a68bdc2ee51 from image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}]). {{(pid=87084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 12:08:25 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_t31v1b17devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 12:08:25 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Image download 20.69 MB at 20.69 MB/s Sep 01 12:08:25 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48aa721-ffef-48a0-a001-7bb68d956543]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:08:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_t31v1b17devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:25 devstack sudo[91874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_t31v1b17devstack@QuobyteHD Sep 01 12:08:25 devstack sudo[91874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:25 devstack sudo[91874]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_t31v1b17devstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:25 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Temporary image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c is fetched for user f521a3a6aa2a4de6a561dcd590273e5e. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 12:08:25 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ce1c70-388d-4a76-a283-3ab44d0fb1cd]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:08:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_t31v1b17devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:25 devstack sudo[91882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_t31v1b17devstack@QuobyteHD Sep 01 12:08:25 devstack sudo[91882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:26 devstack sudo[91882]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_t31v1b17devstack@QuobyteHD" returned: 0 in 0.414s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:08:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:08:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1251568783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14352247-b51d-46cd-a02c-5a68bdc2ee51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb4a63bc4d84e70a520828f5e25554a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:08:24Z,use_quota=True,user_id='f521a3a6aa2a4de6a561dcd590273e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:08:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Creating volume 14352247-b51d-46cd-a02c-5a68bdc2ee51 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:08:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:08:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:08:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:08:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:08:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:08:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:08:26 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:08:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-14352247-b51d-46cd-a02c-5a68bdc2ee51 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:26 devstack sudo[91890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-14352247-b51d-46cd-a02c-5a68bdc2ee51 1073741824 Sep 01 12:08:26 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:26 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-14352247-b51d-46cd-a02c-5a68bdc2ee51 1073741824" returned: 0 in 0.705s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-14352247-b51d-46cd-a02c-5a68bdc2ee51 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:26 devstack sudo[91904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-14352247-b51d-46cd-a02c-5a68bdc2ee51 Sep 01 12:08:26 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:27 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-14352247-b51d-46cd-a02c-5a68bdc2ee51" returned: 0 in 0.396s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:08:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:08:27 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Attempting download of 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c ((None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}])) to volume 14352247-b51d-46cd-a02c-5a68bdc2ee51. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 12:08:27 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4185ca-fee0-46e5-843f-d596a19541ab]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:08:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_anyd_nl3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:27 devstack sudo[91925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_anyd_nl3 Sep 01 12:08:27 devstack sudo[91925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:27 devstack sudo[91925]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_anyd_nl3" returned: 0 in 0.412s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_anyd_nl3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:27 devstack sudo[91935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_anyd_nl3 Sep 01 12:08:27 devstack sudo[91935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:28 devstack sudo[91935]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_anyd_nl3" returned: 1 in 0.505s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_anyd_nl3' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:08:28 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f2254a-9699-4bdc-8d69-6e69f702d3fa]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:08:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_t31v1b17devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:28 devstack sudo[91948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_t31v1b17devstack@QuobyteHD Sep 01 12:08:28 devstack sudo[91948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:28 devstack sudo[91948]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_t31v1b17devstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:28 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c was qcow2, converting to qcow2 {{(pid=87084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 12:08:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_t31v1b17devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-14352247-b51d-46cd-a02c-5a68bdc2ee51 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:28 devstack sudo[91958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_t31v1b17devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-14352247-b51d-46cd-a02c-5a68bdc2ee51 Sep 01 12:08:28 devstack sudo[91958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:31 devstack sudo[91958]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_t31v1b17devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-14352247-b51d-46cd-a02c-5a68bdc2ee51" returned: 0 in 2.382s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:31 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_t31v1b17devstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-14352247-b51d-46cd-a02c-5a68bdc2ee51 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:08:31 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Converted 112.00 MB image at 46.98 MB/s Sep 01 12:08:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-14352247-b51d-46cd-a02c-5a68bdc2ee51 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:31 devstack sudo[91974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-14352247-b51d-46cd-a02c-5a68bdc2ee51 1G Sep 01 12:08:31 devstack sudo[91974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:31 devstack sudo[91974]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-14352247-b51d-46cd-a02c-5a68bdc2ee51 1G" returned: 0 in 0.462s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:31 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Downloaded image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c ((None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}])) to volume 14352247-b51d-46cd-a02c-5a68bdc2ee51 successfully. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 12:08:31 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Temporary image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c for user f521a3a6aa2a4de6a561dcd590273e5e is deleted. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 12:08:31 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Marking volume 14352247-b51d-46cd-a02c-5a68bdc2ee51 as bootable. {{(pid=87084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 12:08:31 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Copying metadata from image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c to 14352247-b51d-46cd-a02c-5a68bdc2ee51. {{(pid=87084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 12:08:31 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Creating volume glance metadata for volume 14352247-b51d-46cd-a02c-5a68bdc2ee51 backed by image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 12:08:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58613a2f-70df-4ea4-b988-6f94f1dff184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14352247-b51d-46cd-a02c-5a68bdc2ee51', 'volume_size': 1, 'image_id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42fce3cc35724a058187a1135a373ea9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'created_at': datetime.datetime(2026, 9, 1, 9, 59, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 59, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:08:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7831671d-0c3d-44ea-88cb-2eb5de6f9fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:08:31 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Volume volume-14352247-b51d-46cd-a02c-5a68bdc2ee51 (14352247-b51d-46cd-a02c-5a68bdc2ee51): created successfully Sep 01 12:08:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7831671d-0c3d-44ea-88cb-2eb5de6f9fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:08:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Flow 'volume_create_manager' (c67a2058-0a27-43cf-9d49-f90d57fde356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:08:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c6129b12-cf01-4955-ad9c-588028d2b0ea tempest-ServerActionsTestOtherA-1571640185 None] Created volume successfully. Sep 01 12:08:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-41e24cf6-8246-4e86-85dd-99cfb851097a req-ad1f912a-0d8b-42f5-b6d6-5d3a439b729c tempest-ServerActionsTestOtherA-1571640185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:08:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-41e24cf6-8246-4e86-85dd-99cfb851097a req-ad1f912a-0d8b-42f5-b6d6-5d3a439b729c tempest-ServerActionsTestOtherA-1571640185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:08:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-41e24cf6-8246-4e86-85dd-99cfb851097a req-ad1f912a-0d8b-42f5-b6d6-5d3a439b729c tempest-ServerActionsTestOtherA-1571640185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.064s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:08:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-41e24cf6-8246-4e86-85dd-99cfb851097a req-ad1f912a-0d8b-42f5-b6d6-5d3a439b729c tempest-ServerActionsTestOtherA-1571640185 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-14352247-b51d-46cd-a02c-5a68bdc2ee51', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96a10c90-f04e-4009-a9f0-401f5625f1f2', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:08:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-41e24cf6-8246-4e86-85dd-99cfb851097a req-ad1f912a-0d8b-42f5-b6d6-5d3a439b729c tempest-ServerActionsTestOtherA-1571640185 None] attachment_update completed successfully. Sep 01 12:08:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:08:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:08:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:08:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:08:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:08:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:08:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:08:41 devstack sudo[92072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:08:41 devstack sudo[92072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:08:42 devstack sudo[92072]: pam_unix(sudo:session): session closed for user root Sep 01 12:08:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.576s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:08:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:08:42 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:08:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:08:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:08:51 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=62,cinder:INSERT=23,cinder:UPDATE=62,cinder:DELETE=4 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:08:51 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:DELETE=3,cinder:UPDATE=48,cinder:SELECT=49,cinder:INSERT=18 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Flow 'volume_create_manager' (9181dfab-9568-456c-861d-64bf5a179a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f57b851c-88b1-454d-b0e3-85fc74695aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f57b851c-88b1-454d-b0e3-85fc74695aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1921376341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fede8fc-65db-4c54-a003-b3f099f209a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b743179ad549c0bac7f393277d344b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:07Z,use_quota=True,user_id='df91cd2d042e448b864713eb9a82afcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8679c86-14d0-4880-a7bc-45269701f635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8679c86-14d0-4880-a7bc-45269701f635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410f8cbd-03c2-4313-8d84-e69220240d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410f8cbd-03c2-4313-8d84-e69220240d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fede8fc-65db-4c54-a003-b3f099f209a7', 'volume_name': 'volume-9fede8fc-65db-4c54-a003-b3f099f209a7', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481240ee-6495-49d6-a05f-7a9c9b092272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481240ee-6495-49d6-a05f-7a9c9b092272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c5078e-5d2f-4776-9994-ca27185353f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:07 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Volume 9fede8fc-65db-4c54-a003-b3f099f209a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fede8fc-65db-4c54-a003-b3f099f209a7', 'volume_size': 1} Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1921376341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fede8fc-65db-4c54-a003-b3f099f209a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b743179ad549c0bac7f393277d344b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:07Z,use_quota=True,user_id='df91cd2d042e448b864713eb9a82afcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Creating volume 9fede8fc-65db-4c54-a003-b3f099f209a7 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:09:07 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:09:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9fede8fc-65db-4c54-a003-b3f099f209a7 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:07 devstack sudo[92762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9fede8fc-65db-4c54-a003-b3f099f209a7 1073741824 Sep 01 12:09:07 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:08 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9fede8fc-65db-4c54-a003-b3f099f209a7 1073741824" returned: 0 in 1.188s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9fede8fc-65db-4c54-a003-b3f099f209a7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:08 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9fede8fc-65db-4c54-a003-b3f099f209a7 Sep 01 12:09:08 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:09 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9fede8fc-65db-4c54-a003-b3f099f209a7" returned: 0 in 0.956s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] <== create_volume: return (2289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:09:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.299s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c5078e-5d2f-4776-9994-ca27185353f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fede8fc-65db-4c54-a003-b3f099f209a7', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (943f20c7-4361-47e3-a5ad-922f2af74dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:09 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Volume volume-9fede8fc-65db-4c54-a003-b3f099f209a7 (9fede8fc-65db-4c54-a003-b3f099f209a7): created successfully Sep 01 12:09:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (943f20c7-4361-47e3-a5ad-922f2af74dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Flow 'volume_create_manager' (9181dfab-9568-456c-861d-64bf5a179a2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:09 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-092f3487-f709-429b-8213-6ece6d01d0e6 tempest-ServersNegativeTestJSON-1425602562 None] Created volume successfully. Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Flow 'volume_create_manager' (268f740e-3d45-4744-802e-24d7bc7091da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93fe9e5-e3e6-45da-a85d-e2a1ef929df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93fe9e5-e3e6-45da-a85d-e2a1ef929df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1686256651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4828968ce3ce4fdcad5bd9e29b606a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:15Z,use_quota=True,user_id='a70a1386b07a44f5be448fb83df91646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d0aa4d-7cbc-4281-bbd7-ec100aed23f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d0aa4d-7cbc-4281-bbd7-ec100aed23f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a1ade6-9f5a-4aa1-9eef-88b84ce0030e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a1ade6-9f5a-4aa1-9eef-88b84ce0030e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2', 'volume_name': 'volume-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969a05ad-76af-419b-9901-a3ac62bb43d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969a05ad-76af-419b-9901-a3ac62bb43d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c003324-728e-4a7d-8eb6-ad128e75ca8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:15 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Volume 5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2', 'volume_size': 1} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1686256651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4828968ce3ce4fdcad5bd9e29b606a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:15Z,use_quota=True,user_id='a70a1386b07a44f5be448fb83df91646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Creating volume 5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:09:15 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:09:15 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2 1073741824 Sep 01 12:09:15 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Flow 'volume_create_manager' (edc96420-342a-495e-9e63-a79e2885cac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f92255d7-44e5-4626-bd3a-255f3cd75ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f92255d7-44e5-4626-bd3a-255f3cd75ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1300423992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b743179ad549c0bac7f393277d344b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:15Z,use_quota=True,user_id='df91cd2d042e448b864713eb9a82afcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fb0fa9-4dfe-46cb-8ddc-42c032441dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fb0fa9-4dfe-46cb-8ddc-42c032441dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2cfd67d-0b85-4aaa-b405-dc16ceeae9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2cfd67d-0b85-4aaa-b405-dc16ceeae9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf', 'volume_name': 'volume-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5155a8a9-7086-409e-9309-b4aa9d27ddb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5155a8a9-7086-409e-9309-b4aa9d27ddb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4d69ec-e1a3-4f80-a14b-5b376e561da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:15 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Volume 5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf', 'volume_size': 1} Sep 01 12:09:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:16 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2 1073741824" returned: 0 in 0.969s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:16 devstack sudo[92912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2 Sep 01 12:09:16 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:17 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2" returned: 0 in 0.630s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:09:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.507s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1300423992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b743179ad549c0bac7f393277d344b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:15Z,use_quota=True,user_id='df91cd2d042e448b864713eb9a82afcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:09:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Creating volume 5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:09:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:09:17 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:09:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:17 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf 1073741824 Sep 01 12:09:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c003324-728e-4a7d-8eb6-ad128e75ca8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2ede39-9128-4f75-9862-06c4c98aa8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:17 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:17 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Volume volume-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2 (5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2): created successfully Sep 01 12:09:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2ede39-9128-4f75-9862-06c4c98aa8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Flow 'volume_create_manager' (268f740e-3d45-4744-802e-24d7bc7091da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:17 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6f7877d8-3e6e-4697-bde4-5793d55e00d4 tempest-VolumesActionsTest-468530088 None] Created volume successfully. Sep 01 12:09:18 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-7d622434-b294-4388-be71-a4ad25269c8b req-f77942af-9efb-4c4e-9d71-94f28e5fa052 tempest-ServerActionsTestOtherA-1571640185 None] Terminate volume connection completed successfully. Sep 01 12:09:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-7d622434-b294-4388-be71-a4ad25269c8b req-f77942af-9efb-4c4e-9d71-94f28e5fa052 tempest-ServerActionsTestOtherA-1571640185 None] Deleting attachment 96a10c90-f04e-4009-a9f0-401f5625f1f2. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:09:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8f406edd-e548-46e2-baf9-d9a8a38ad795 tempest-VolumesActionsTest-468530088 None] Acquiring lock "cinder-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2" by "attach_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8f406edd-e548-46e2-baf9-d9a8a38ad795 tempest-VolumesActionsTest-468530088 None] Lock "cinder-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2" acquired by "attach_volume" :: waited 0.054s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:18 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8f406edd-e548-46e2-baf9-d9a8a38ad795 tempest-VolumesActionsTest-468530088 None] Attaching volume 5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2 to instance 7335a450-4424-4403-9118-b627f2e5e675 at mountpoint /dev/vdb on host None. Sep 01 12:09:18 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf 1073741824" returned: 0 in 1.328s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:18 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8f406edd-e548-46e2-baf9-d9a8a38ad795 tempest-VolumesActionsTest-468530088 None] Attach volume completed successfully. Sep 01 12:09:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8f406edd-e548-46e2-baf9-d9a8a38ad795 tempest-VolumesActionsTest-468530088 None] Lock "cinder-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2" released by "attach_volume" :: held 0.310s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:18 devstack sudo[92970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf Sep 01 12:09:18 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:19 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf" returned: 0 in 0.494s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] <== create_volume: return (1978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:09:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4d69ec-e1a3-4f80-a14b-5b376e561da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f11807-24a7-40c8-91a1-fc9d5863c3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:19 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Volume volume-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf (5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf): created successfully Sep 01 12:09:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f11807-24a7-40c8-91a1-fc9d5863c3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Flow 'volume_create_manager' (edc96420-342a-495e-9e63-a79e2885cac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:19 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b090d00e-ed5a-4781-a9db-b0a1aeb9f0c0 tempest-ServersNegativeTestJSON-1425602562 None] Created volume successfully. Sep 01 12:09:19 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-27fa5cef-ff75-4f66-a3f0-42d437647d7a tempest-VolumesActionsTest-1002036497 None] Terminate volume connection completed successfully. Sep 01 12:09:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-27fa5cef-ff75-4f66-a3f0-42d437647d7a tempest-VolumesActionsTest-1002036497 None] Acquiring lock "cinder-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2-detach_volume" by "detach_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-27fa5cef-ff75-4f66-a3f0-42d437647d7a tempest-VolumesActionsTest-1002036497 None] Lock "cinder-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:19 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-27fa5cef-ff75-4f66-a3f0-42d437647d7a tempest-VolumesActionsTest-1002036497 None] Detaching volume 5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2 from instance 7335a450-4424-4403-9118-b627f2e5e675. Sep 01 12:09:19 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-27fa5cef-ff75-4f66-a3f0-42d437647d7a tempest-VolumesActionsTest-1002036497 None] Detach volume completed successfully. Sep 01 12:09:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-27fa5cef-ff75-4f66-a3f0-42d437647d7a tempest-VolumesActionsTest-1002036497 None] Lock "cinder-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bfa5cef2-3502-43ae-9c25-f662a88ae52f tempest-VolumesActionsTest-468530088 None] Acquiring lock "cinder-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2-detach_volume" by "detach_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bfa5cef2-3502-43ae-9c25-f662a88ae52f tempest-VolumesActionsTest-468530088 None] Lock "cinder-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:20 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-bfa5cef2-3502-43ae-9c25-f662a88ae52f tempest-VolumesActionsTest-468530088 None] Volume detach called, but volume not attached. Sep 01 12:09:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bfa5cef2-3502-43ae-9c25-f662a88ae52f tempest-VolumesActionsTest-468530088 None] Lock "cinder-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2-detach_volume" released by "detach_volume" :: held 0.028s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-083b2ae3-6c8d-41d9-a7be-ba42d7bce997 tempest-VolumesActionsTest-468530088 None] Acquiring lock "cinder-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-083b2ae3-6c8d-41d9-a7be-ba42d7bce997 tempest-VolumesActionsTest-468530088 None] Lock "cinder-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-7d622434-b294-4388-be71-a4ad25269c8b req-d3098ade-7283-4546-b6a0-999b946c0fc1 tempest-ServerActionsTestOtherA-1571640185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-7d622434-b294-4388-be71-a4ad25269c8b req-d3098ade-7283-4546-b6a0-999b946c0fc1 tempest-ServerActionsTestOtherA-1571640185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-563ea635-b10b-44f3-ae6d-e473a154f935 tempest-ServersNegativeTestJSON-1425602562 None] Acquiring lock "cinder-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-083b2ae3-6c8d-41d9-a7be-ba42d7bce997 tempest-VolumesActionsTest-468530088 None] Acquiring lock "cinder-quobyte-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-7d622434-b294-4388-be71-a4ad25269c8b req-d3098ade-7283-4546-b6a0-999b946c0fc1 tempest-ServerActionsTestOtherA-1571640185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.060s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-083b2ae3-6c8d-41d9-a7be-ba42d7bce997 tempest-VolumesActionsTest-468530088 None] Lock "cinder-quobyte-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2" acquired by "delete_volume" :: waited 0.042s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-563ea635-b10b-44f3-ae6d-e473a154f935 tempest-ServersNegativeTestJSON-1425602562 None] Lock "cinder-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:20 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88a7d75-3087-421a-aa15-347e92da0c1d]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:09:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-083b2ae3-6c8d-41d9-a7be-ba42d7bce997 tempest-VolumesActionsTest-468530088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-7d622434-b294-4388-be71-a4ad25269c8b req-d3098ade-7283-4546-b6a0-999b946c0fc1 tempest-ServerActionsTestOtherA-1571640185 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-14352247-b51d-46cd-a02c-5a68bdc2ee51', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '469e6180-bbb1-40fc-a338-41c3968a8d38', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:09:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-563ea635-b10b-44f3-ae6d-e473a154f935 tempest-ServersNegativeTestJSON-1425602562 None] Acquiring lock "cinder-quobyte-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-563ea635-b10b-44f3-ae6d-e473a154f935 tempest-ServersNegativeTestJSON-1425602562 None] Lock "cinder-quobyte-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf" acquired by "delete_volume" :: waited 0.040s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:20 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[361224ce-2b8b-499d-9a83-2608f61354e4]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:09:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-563ea635-b10b-44f3-ae6d-e473a154f935 tempest-ServersNegativeTestJSON-1425602562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:20 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2 Sep 01 12:09:20 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:20 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-7d622434-b294-4388-be71-a4ad25269c8b req-d3098ade-7283-4546-b6a0-999b946c0fc1 tempest-ServerActionsTestOtherA-1571640185 None] attachment_update completed successfully. Sep 01 12:09:21 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf Sep 01 12:09:21 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:21 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-083b2ae3-6c8d-41d9-a7be-ba42d7bce997 tempest-VolumesActionsTest-468530088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2" returned: 0 in 0.688s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-083b2ae3-6c8d-41d9-a7be-ba42d7bce997 tempest-VolumesActionsTest-468530088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:21 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:21 devstack sudo[92993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2 Sep 01 12:09:21 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-563ea635-b10b-44f3-ae6d-e473a154f935 tempest-ServersNegativeTestJSON-1425602562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf" returned: 0 in 0.618s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-563ea635-b10b-44f3-ae6d-e473a154f935 tempest-ServersNegativeTestJSON-1425602562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:21 devstack sudo[93017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf Sep 01 12:09:21 devstack sudo[93017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:21 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-083b2ae3-6c8d-41d9-a7be-ba42d7bce997 tempest-VolumesActionsTest-468530088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2" returned: 0 in 0.561s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:22 devstack sudo[93017]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-083b2ae3-6c8d-41d9-a7be-ba42d7bce997 tempest-VolumesActionsTest-468530088 None] Lock "cinder-quobyte-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2" released by "delete_volume" :: held 1.369s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-563ea635-b10b-44f3-ae6d-e473a154f935 tempest-ServersNegativeTestJSON-1425602562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf" returned: 0 in 0.580s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-563ea635-b10b-44f3-ae6d-e473a154f935 tempest-ServersNegativeTestJSON-1425602562 None] Lock "cinder-quobyte-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf" released by "delete_volume" :: held 1.270s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:22 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-083b2ae3-6c8d-41d9-a7be-ba42d7bce997 tempest-VolumesActionsTest-468530088 None] Created reservations ['cf07b7a6-a337-4196-b4fb-1dccf2528a94', 'b4fac03b-b5ce-45d1-9850-505646213525', 'ee4f813a-07be-4349-be1a-10a58bcf15b2', '57fd2743-feb0-43d2-813a-a35e70ee8647'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:09:22 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-563ea635-b10b-44f3-ae6d-e473a154f935 tempest-ServersNegativeTestJSON-1425602562 None] Created reservations ['4951f392-2887-4829-a1f0-b2679cc28ffd', 'f001e0ce-3138-45f4-a214-4ad971bab812', '4ccfc593-0954-40da-99f8-bd27cb8a2689', 'd799deae-d828-431d-b7fb-21f37c559342'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:09:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-083b2ae3-6c8d-41d9-a7be-ba42d7bce997 tempest-VolumesActionsTest-468530088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-083b2ae3-6c8d-41d9-a7be-ba42d7bce997 tempest-VolumesActionsTest-468530088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-083b2ae3-6c8d-41d9-a7be-ba42d7bce997 tempest-VolumesActionsTest-468530088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-083b2ae3-6c8d-41d9-a7be-ba42d7bce997 tempest-VolumesActionsTest-468530088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-083b2ae3-6c8d-41d9-a7be-ba42d7bce997 tempest-VolumesActionsTest-468530088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-083b2ae3-6c8d-41d9-a7be-ba42d7bce997 tempest-VolumesActionsTest-468530088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:22 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:09:22 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-563ea635-b10b-44f3-ae6d-e473a154f935 tempest-ServersNegativeTestJSON-1425602562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-563ea635-b10b-44f3-ae6d-e473a154f935 tempest-ServersNegativeTestJSON-1425602562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-563ea635-b10b-44f3-ae6d-e473a154f935 tempest-ServersNegativeTestJSON-1425602562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-563ea635-b10b-44f3-ae6d-e473a154f935 tempest-ServersNegativeTestJSON-1425602562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-563ea635-b10b-44f3-ae6d-e473a154f935 tempest-ServersNegativeTestJSON-1425602562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-563ea635-b10b-44f3-ae6d-e473a154f935 tempest-ServersNegativeTestJSON-1425602562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:22 devstack sudo[93408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:09:22 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:23 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-083b2ae3-6c8d-41d9-a7be-ba42d7bce997 tempest-VolumesActionsTest-468530088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.552s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:23 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-083b2ae3-6c8d-41d9-a7be-ba42d7bce997 tempest-VolumesActionsTest-468530088 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:09:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-083b2ae3-6c8d-41d9-a7be-ba42d7bce997 tempest-VolumesActionsTest-468530088 None] Deleted volume successfully. Sep 01 12:09:23 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-563ea635-b10b-44f3-ae6d-e473a154f935 tempest-ServersNegativeTestJSON-1425602562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.511s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:23 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-563ea635-b10b-44f3-ae6d-e473a154f935 tempest-ServersNegativeTestJSON-1425602562 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:09:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-083b2ae3-6c8d-41d9-a7be-ba42d7bce997 tempest-VolumesActionsTest-468530088 None] Lock "cinder-5eb12dc7-2bbe-4949-9f22-bfeb2ff360f2-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-563ea635-b10b-44f3-ae6d-e473a154f935 tempest-ServersNegativeTestJSON-1425602562 None] Deleted volume successfully. Sep 01 12:09:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-563ea635-b10b-44f3-ae6d-e473a154f935 tempest-ServersNegativeTestJSON-1425602562 None] Lock "cinder-5c32c531-c3b3-46ad-afe6-f1b4b5cc3bbf-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-caa303d4-1cf7-427b-af37-07d4a32deba3 tempest-ServersNegativeTestJSON-1425602562 None] Acquiring lock "cinder-9fede8fc-65db-4c54-a003-b3f099f209a7-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-caa303d4-1cf7-427b-af37-07d4a32deba3 tempest-ServersNegativeTestJSON-1425602562 None] Lock "cinder-9fede8fc-65db-4c54-a003-b3f099f209a7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-caa303d4-1cf7-427b-af37-07d4a32deba3 tempest-ServersNegativeTestJSON-1425602562 None] Acquiring lock "cinder-quobyte-9fede8fc-65db-4c54-a003-b3f099f209a7" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-caa303d4-1cf7-427b-af37-07d4a32deba3 tempest-ServersNegativeTestJSON-1425602562 None] Lock "cinder-quobyte-9fede8fc-65db-4c54-a003-b3f099f209a7" acquired by "delete_volume" :: waited 0.034s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:23 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5c9228-19ff-4318-9197-a53eb47625fa]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:09:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-caa303d4-1cf7-427b-af37-07d4a32deba3 tempest-ServersNegativeTestJSON-1425602562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9fede8fc-65db-4c54-a003-b3f099f209a7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:23 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9fede8fc-65db-4c54-a003-b3f099f209a7 Sep 01 12:09:23 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:24 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-caa303d4-1cf7-427b-af37-07d4a32deba3 tempest-ServersNegativeTestJSON-1425602562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9fede8fc-65db-4c54-a003-b3f099f209a7" returned: 0 in 0.646s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-caa303d4-1cf7-427b-af37-07d4a32deba3 tempest-ServersNegativeTestJSON-1425602562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9fede8fc-65db-4c54-a003-b3f099f209a7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:24 devstack sudo[93448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9fede8fc-65db-4c54-a003-b3f099f209a7 Sep 01 12:09:24 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:24 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-caa303d4-1cf7-427b-af37-07d4a32deba3 tempest-ServersNegativeTestJSON-1425602562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9fede8fc-65db-4c54-a003-b3f099f209a7" returned: 0 in 0.347s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-caa303d4-1cf7-427b-af37-07d4a32deba3 tempest-ServersNegativeTestJSON-1425602562 None] Lock "cinder-quobyte-9fede8fc-65db-4c54-a003-b3f099f209a7" released by "delete_volume" :: held 1.090s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:24 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-caa303d4-1cf7-427b-af37-07d4a32deba3 tempest-ServersNegativeTestJSON-1425602562 None] Created reservations ['657b692f-701b-4b0c-b9fa-94f6dfdf3d4c', 'f3c41919-4751-4f3d-8b55-1f11f25a23bc', 'ec10b0d2-bc15-486b-bafc-f6d755bb5a94', '86126f3b-ca11-4c88-90da-ae6753531ec4'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:09:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-caa303d4-1cf7-427b-af37-07d4a32deba3 tempest-ServersNegativeTestJSON-1425602562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-caa303d4-1cf7-427b-af37-07d4a32deba3 tempest-ServersNegativeTestJSON-1425602562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-caa303d4-1cf7-427b-af37-07d4a32deba3 tempest-ServersNegativeTestJSON-1425602562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-caa303d4-1cf7-427b-af37-07d4a32deba3 tempest-ServersNegativeTestJSON-1425602562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-caa303d4-1cf7-427b-af37-07d4a32deba3 tempest-ServersNegativeTestJSON-1425602562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-caa303d4-1cf7-427b-af37-07d4a32deba3 tempest-ServersNegativeTestJSON-1425602562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:24 devstack sudo[93454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:09:24 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:25 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-caa303d4-1cf7-427b-af37-07d4a32deba3 tempest-ServersNegativeTestJSON-1425602562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.510s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:25 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-caa303d4-1cf7-427b-af37-07d4a32deba3 tempest-ServersNegativeTestJSON-1425602562 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:09:25 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-caa303d4-1cf7-427b-af37-07d4a32deba3 tempest-ServersNegativeTestJSON-1425602562 None] Deleted volume successfully. Sep 01 12:09:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-caa303d4-1cf7-427b-af37-07d4a32deba3 tempest-ServersNegativeTestJSON-1425602562 None] Lock "cinder-9fede8fc-65db-4c54-a003-b3f099f209a7-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Flow 'volume_create_manager' (f4d17a92-b77a-40e8-82d7-517d69a4b555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c891cd90-559a-4d2b-9f53-aedb8c20bd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c891cd90-559a-4d2b-9f53-aedb8c20bd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-374830578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4828968ce3ce4fdcad5bd9e29b606a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:29Z,use_quota=True,user_id='a70a1386b07a44f5be448fb83df91646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75ce39d4-d10c-4907-829b-b71f0ba64371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75ce39d4-d10c-4907-829b-b71f0ba64371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9403ae4a-a81b-45bb-957b-adcec34bad6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9403ae4a-a81b-45bb-957b-adcec34bad6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed', 'volume_name': 'volume-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b218eb10-123a-468f-9f06-d6888499fc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b218eb10-123a-468f-9f06-d6888499fc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269ec79e-47ca-47c3-8cdb-dd47df3d657d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:29 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Volume 0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed', 'volume_size': 1} Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-374830578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4828968ce3ce4fdcad5bd9e29b606a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:29Z,use_quota=True,user_id='a70a1386b07a44f5be448fb83df91646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Creating volume 0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:09:29 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:09:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:29 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed 1073741824 Sep 01 12:09:29 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:30 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed 1073741824" returned: 0 in 0.770s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:30 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed Sep 01 12:09:30 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:30 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed" returned: 0 in 0.583s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:09:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269ec79e-47ca-47c3-8cdb-dd47df3d657d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1abd9d4e-7b63-494b-9ae6-4357742316d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:31 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Volume volume-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed (0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed): created successfully Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1abd9d4e-7b63-494b-9ae6-4357742316d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Flow 'volume_create_manager' (f4d17a92-b77a-40e8-82d7-517d69a4b555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Flow 'volume_create_manager' (cbc33e95-3928-4af4-864a-0c6f541eb0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b56ff37-f977-42d3-97cc-ccf30b48f23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ba99907b-be81-405e-8ba0-bdf2687a7cec tempest-VolumesActionsTest-468530088 None] Created volume successfully. Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b56ff37-f977-42d3-97cc-ccf30b48f23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-20096443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23405ce4-7e87-4078-94e0-1da38dd49aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0ababc7f215448abdc4f82aa4be91a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:31Z,use_quota=True,user_id='90388626c4204528ab5f133fc59378fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb463a93-a357-4af9-bc95-eaf066eb2e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb463a93-a357-4af9-bc95-eaf066eb2e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe03cee-165c-4653-8fc3-8b7216aab0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe03cee-165c-4653-8fc3-8b7216aab0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23405ce4-7e87-4078-94e0-1da38dd49aa4', 'volume_name': 'volume-23405ce4-7e87-4078-94e0-1da38dd49aa4', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64fec7b-e7c0-44c4-a844-1b209555505f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64fec7b-e7c0-44c4-a844-1b209555505f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5bcaf5-3f41-47f4-a8f6-a081bd2e11db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:31 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Volume 23405ce4-7e87-4078-94e0-1da38dd49aa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23405ce4-7e87-4078-94e0-1da38dd49aa4', 'volume_size': 1} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-20096443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23405ce4-7e87-4078-94e0-1da38dd49aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0ababc7f215448abdc4f82aa4be91a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:31Z,use_quota=True,user_id='90388626c4204528ab5f133fc59378fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Creating volume 23405ce4-7e87-4078-94e0-1da38dd49aa4 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:09:31 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-23405ce4-7e87-4078-94e0-1da38dd49aa4 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:31 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-23405ce4-7e87-4078-94e0-1da38dd49aa4 1073741824 Sep 01 12:09:31 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e36ccd3f-e72b-4b93-962b-7babb5ea6d9f tempest-VolumesActionsTest-1002036497 None] Acquiring lock "cinder-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e36ccd3f-e72b-4b93-962b-7babb5ea6d9f tempest-VolumesActionsTest-1002036497 None] Lock "cinder-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e36ccd3f-e72b-4b93-962b-7babb5ea6d9f tempest-VolumesActionsTest-1002036497 None] Acquiring lock "cinder-quobyte-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e36ccd3f-e72b-4b93-962b-7babb5ea6d9f tempest-VolumesActionsTest-1002036497 None] Lock "cinder-quobyte-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed" acquired by "delete_volume" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9b0142-b5fd-4971-b99a-076731abf8c9]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:09:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e36ccd3f-e72b-4b93-962b-7babb5ea6d9f tempest-VolumesActionsTest-1002036497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:32 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:32 devstack sudo[93506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed Sep 01 12:09:32 devstack sudo[93506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-23405ce4-7e87-4078-94e0-1da38dd49aa4 1073741824" returned: 0 in 0.745s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-23405ce4-7e87-4078-94e0-1da38dd49aa4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:32 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-23405ce4-7e87-4078-94e0-1da38dd49aa4 Sep 01 12:09:32 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:32 devstack sudo[93506]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e36ccd3f-e72b-4b93-962b-7babb5ea6d9f tempest-VolumesActionsTest-1002036497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed" returned: 0 in 0.482s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e36ccd3f-e72b-4b93-962b-7babb5ea6d9f tempest-VolumesActionsTest-1002036497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:32 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed Sep 01 12:09:32 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:32 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-23405ce4-7e87-4078-94e0-1da38dd49aa4" returned: 0 in 0.298s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:09:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5bcaf5-3f41-47f4-a8f6-a081bd2e11db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23405ce4-7e87-4078-94e0-1da38dd49aa4', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c108912-5413-4b8e-aace-e90f7320665d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:32 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Volume volume-23405ce4-7e87-4078-94e0-1da38dd49aa4 (23405ce4-7e87-4078-94e0-1da38dd49aa4): created successfully Sep 01 12:09:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c108912-5413-4b8e-aace-e90f7320665d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Flow 'volume_create_manager' (cbc33e95-3928-4af4-864a-0c6f541eb0ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:32 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f4f08b7c-fe47-4993-be95-fba04fec09c4 tempest-AttachVolumeTestJSON-1344929934 None] Created volume successfully. Sep 01 12:09:32 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e36ccd3f-e72b-4b93-962b-7babb5ea6d9f tempest-VolumesActionsTest-1002036497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed" returned: 0 in 0.325s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e36ccd3f-e72b-4b93-962b-7babb5ea6d9f tempest-VolumesActionsTest-1002036497 None] Lock "cinder-quobyte-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed" released by "delete_volume" :: held 0.870s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:32 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-e36ccd3f-e72b-4b93-962b-7babb5ea6d9f tempest-VolumesActionsTest-1002036497 None] Created reservations ['79b693ef-12d1-44df-9082-274d7aeb08a0', '87c2cba2-9e0b-4894-aad5-93fec372fe75', '588ea6b2-78bd-4531-96e5-3e7bd16d1ad1', 'c10bba67-0e04-4ef0-8264-1733d0b794c0'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:09:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e36ccd3f-e72b-4b93-962b-7babb5ea6d9f tempest-VolumesActionsTest-1002036497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e36ccd3f-e72b-4b93-962b-7babb5ea6d9f tempest-VolumesActionsTest-1002036497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e36ccd3f-e72b-4b93-962b-7babb5ea6d9f tempest-VolumesActionsTest-1002036497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e36ccd3f-e72b-4b93-962b-7babb5ea6d9f tempest-VolumesActionsTest-1002036497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e36ccd3f-e72b-4b93-962b-7babb5ea6d9f tempest-VolumesActionsTest-1002036497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e36ccd3f-e72b-4b93-962b-7babb5ea6d9f tempest-VolumesActionsTest-1002036497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:32 devstack sudo[93520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:09:32 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:33 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e36ccd3f-e72b-4b93-962b-7babb5ea6d9f tempest-VolumesActionsTest-1002036497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.330s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-e36ccd3f-e72b-4b93-962b-7babb5ea6d9f tempest-VolumesActionsTest-1002036497 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:09:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e36ccd3f-e72b-4b93-962b-7babb5ea6d9f tempest-VolumesActionsTest-1002036497 None] Deleted volume successfully. Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e36ccd3f-e72b-4b93-962b-7babb5ea6d9f tempest-VolumesActionsTest-1002036497 None] Lock "cinder-0bdbd75c-d452-43af-b7c5-d5dbd9b1f0ed-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Flow 'volume_create_manager' (0ffbc3de-a121-49d6-94ab-0389b199d499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f60528-d41e-410b-a0df-e5b339640745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f60528-d41e-410b-a0df-e5b339640745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1111013846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e1bd79-5dde-42ab-8676-0896480c394d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4828968ce3ce4fdcad5bd9e29b606a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:34Z,use_quota=True,user_id='a70a1386b07a44f5be448fb83df91646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f911fd-d706-4937-ac06-76b949183f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f911fd-d706-4937-ac06-76b949183f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234a267b-ba92-415a-9dd6-5df4f2d629d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234a267b-ba92-415a-9dd6-5df4f2d629d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77e1bd79-5dde-42ab-8676-0896480c394d', 'volume_name': 'volume-77e1bd79-5dde-42ab-8676-0896480c394d', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (559da119-d767-42bf-8233-cbcb0ead5ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (559da119-d767-42bf-8233-cbcb0ead5ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5adbe408-d19a-4cd8-a79f-2e3b4efa9373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:33 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Volume 77e1bd79-5dde-42ab-8676-0896480c394d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77e1bd79-5dde-42ab-8676-0896480c394d', 'volume_size': 1} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1111013846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e1bd79-5dde-42ab-8676-0896480c394d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4828968ce3ce4fdcad5bd9e29b606a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:34Z,use_quota=True,user_id='a70a1386b07a44f5be448fb83df91646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Creating volume 77e1bd79-5dde-42ab-8676-0896480c394d {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:09:33 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:09:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e1bd79-5dde-42ab-8676-0896480c394d 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:33 devstack sudo[93528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e1bd79-5dde-42ab-8676-0896480c394d 1073741824 Sep 01 12:09:33 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-3becc243-6b08-453d-94cf-10a91ba43e87 req-6fd2674f-49f4-411c-a0b5-bc1304007412 tempest-AttachVolumeTestJSON-1344929934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:34 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e1bd79-5dde-42ab-8676-0896480c394d 1073741824" returned: 0 in 0.457s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e1bd79-5dde-42ab-8676-0896480c394d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:34 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e1bd79-5dde-42ab-8676-0896480c394d Sep 01 12:09:34 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:34 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e1bd79-5dde-42ab-8676-0896480c394d" returned: 0 in 0.263s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:09:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-3becc243-6b08-453d-94cf-10a91ba43e87 req-6fd2674f-49f4-411c-a0b5-bc1304007412 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.410s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-3becc243-6b08-453d-94cf-10a91ba43e87 req-6fd2674f-49f4-411c-a0b5-bc1304007412 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5adbe408-d19a-4cd8-a79f-2e3b4efa9373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e1bd79-5dde-42ab-8676-0896480c394d', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d4aff0-2629-4a86-9608-03c4180eb810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:34 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Volume volume-77e1bd79-5dde-42ab-8676-0896480c394d (77e1bd79-5dde-42ab-8676-0896480c394d): created successfully Sep 01 12:09:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d4aff0-2629-4a86-9608-03c4180eb810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Flow 'volume_create_manager' (0ffbc3de-a121-49d6-94ab-0389b199d499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-3becc243-6b08-453d-94cf-10a91ba43e87 req-6fd2674f-49f4-411c-a0b5-bc1304007412 tempest-AttachVolumeTestJSON-1344929934 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-23405ce4-7e87-4078-94e0-1da38dd49aa4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b059ba5-a53a-4a16-91f1-9e1e60d97d48', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:09:34 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a6a47335-5556-41b5-a63e-0a5d9fe2ed61 tempest-VolumesActionsTest-468530088 None] Created volume successfully. Sep 01 12:09:34 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-3becc243-6b08-453d-94cf-10a91ba43e87 req-6fd2674f-49f4-411c-a0b5-bc1304007412 tempest-AttachVolumeTestJSON-1344929934 None] attachment_update completed successfully. Sep 01 12:09:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f67f22f9-b6fe-41f1-8a02-cd3d57ec7487 tempest-VolumesActionsTest-1002036497 None] Acquiring lock "cinder-77e1bd79-5dde-42ab-8676-0896480c394d-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f67f22f9-b6fe-41f1-8a02-cd3d57ec7487 tempest-VolumesActionsTest-1002036497 None] Lock "cinder-77e1bd79-5dde-42ab-8676-0896480c394d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f67f22f9-b6fe-41f1-8a02-cd3d57ec7487 tempest-VolumesActionsTest-1002036497 None] Acquiring lock "cinder-quobyte-77e1bd79-5dde-42ab-8676-0896480c394d" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f67f22f9-b6fe-41f1-8a02-cd3d57ec7487 tempest-VolumesActionsTest-1002036497 None] Lock "cinder-quobyte-77e1bd79-5dde-42ab-8676-0896480c394d" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:36 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d60b12f-66d8-4441-8424-df8f41a05e5f]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:09:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f67f22f9-b6fe-41f1-8a02-cd3d57ec7487 tempest-VolumesActionsTest-1002036497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e1bd79-5dde-42ab-8676-0896480c394d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:36 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e1bd79-5dde-42ab-8676-0896480c394d Sep 01 12:09:36 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:36 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f67f22f9-b6fe-41f1-8a02-cd3d57ec7487 tempest-VolumesActionsTest-1002036497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e1bd79-5dde-42ab-8676-0896480c394d" returned: 0 in 0.498s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f67f22f9-b6fe-41f1-8a02-cd3d57ec7487 tempest-VolumesActionsTest-1002036497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e1bd79-5dde-42ab-8676-0896480c394d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:36 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e1bd79-5dde-42ab-8676-0896480c394d Sep 01 12:09:36 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Flow 'volume_create_manager' (89f51906-2500-4f31-a39e-46368c24bcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae175fd-3f86-4204-81bb-ec3e2ee3f913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:37 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae175fd-3f86-4204-81bb-ec3e2ee3f913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1439689832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6469305b-1ba8-4e5a-b136-5a2b08ee9aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0ababc7f215448abdc4f82aa4be91a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:37Z,use_quota=True,user_id='90388626c4204528ab5f133fc59378fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5023ac9b-d1a9-4a34-b9c4-2e15bc0706aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5023ac9b-d1a9-4a34-b9c4-2e15bc0706aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57063648-1c21-45d9-b34c-d3f855d0cbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57063648-1c21-45d9-b34c-d3f855d0cbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6469305b-1ba8-4e5a-b136-5a2b08ee9aec', 'volume_name': 'volume-6469305b-1ba8-4e5a-b136-5a2b08ee9aec', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4beb917-7e7a-4712-a9de-a2b5d6c88e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4beb917-7e7a-4712-a9de-a2b5d6c88e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc523f1-ba02-4376-add5-875d1c1ff46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:37 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Volume 6469305b-1ba8-4e5a-b136-5a2b08ee9aec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6469305b-1ba8-4e5a-b136-5a2b08ee9aec', 'volume_size': 1} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1439689832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6469305b-1ba8-4e5a-b136-5a2b08ee9aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0ababc7f215448abdc4f82aa4be91a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:37Z,use_quota=True,user_id='90388626c4204528ab5f133fc59378fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Creating volume 6469305b-1ba8-4e5a-b136-5a2b08ee9aec {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:09:37 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6469305b-1ba8-4e5a-b136-5a2b08ee9aec 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f67f22f9-b6fe-41f1-8a02-cd3d57ec7487 tempest-VolumesActionsTest-1002036497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e1bd79-5dde-42ab-8676-0896480c394d" returned: 0 in 0.492s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:37 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6469305b-1ba8-4e5a-b136-5a2b08ee9aec 1073741824 Sep 01 12:09:37 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f67f22f9-b6fe-41f1-8a02-cd3d57ec7487 tempest-VolumesActionsTest-1002036497 None] Lock "cinder-quobyte-77e1bd79-5dde-42ab-8676-0896480c394d" released by "delete_volume" :: held 1.063s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-f67f22f9-b6fe-41f1-8a02-cd3d57ec7487 tempest-VolumesActionsTest-1002036497 None] Created reservations ['7d92d751-6cb0-4fd3-9e91-04713ba60a6d', '64efa058-8581-4e94-81d9-6319a3c2c448', '6ff9e241-a68a-4b6b-bf6b-b26cd104723d', 'f7dc3428-7fcb-4221-8968-b31e889f119b'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f67f22f9-b6fe-41f1-8a02-cd3d57ec7487 tempest-VolumesActionsTest-1002036497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f67f22f9-b6fe-41f1-8a02-cd3d57ec7487 tempest-VolumesActionsTest-1002036497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f67f22f9-b6fe-41f1-8a02-cd3d57ec7487 tempest-VolumesActionsTest-1002036497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f67f22f9-b6fe-41f1-8a02-cd3d57ec7487 tempest-VolumesActionsTest-1002036497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f67f22f9-b6fe-41f1-8a02-cd3d57ec7487 tempest-VolumesActionsTest-1002036497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f67f22f9-b6fe-41f1-8a02-cd3d57ec7487 tempest-VolumesActionsTest-1002036497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:37 devstack sudo[93560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:09:37 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:37 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f67f22f9-b6fe-41f1-8a02-cd3d57ec7487 tempest-VolumesActionsTest-1002036497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.283s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-f67f22f9-b6fe-41f1-8a02-cd3d57ec7487 tempest-VolumesActionsTest-1002036497 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:09:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f67f22f9-b6fe-41f1-8a02-cd3d57ec7487 tempest-VolumesActionsTest-1002036497 None] Deleted volume successfully. Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f67f22f9-b6fe-41f1-8a02-cd3d57ec7487 tempest-VolumesActionsTest-1002036497 None] Lock "cinder-77e1bd79-5dde-42ab-8676-0896480c394d-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:37 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6469305b-1ba8-4e5a-b136-5a2b08ee9aec 1073741824" returned: 0 in 0.644s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6469305b-1ba8-4e5a-b136-5a2b08ee9aec {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:38 devstack sudo[93567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6469305b-1ba8-4e5a-b136-5a2b08ee9aec Sep 01 12:09:38 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:38 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6469305b-1ba8-4e5a-b136-5a2b08ee9aec" returned: 0 in 0.337s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:09:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc523f1-ba02-4376-add5-875d1c1ff46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6469305b-1ba8-4e5a-b136-5a2b08ee9aec', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1a503e-5d82-47b9-91a2-b5f3dfd4181f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:38 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Volume volume-6469305b-1ba8-4e5a-b136-5a2b08ee9aec (6469305b-1ba8-4e5a-b136-5a2b08ee9aec): created successfully Sep 01 12:09:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1a503e-5d82-47b9-91a2-b5f3dfd4181f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Flow 'volume_create_manager' (89f51906-2500-4f31-a39e-46368c24bcb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:38 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e95cd26a-2eaa-47a2-a13a-8e5e8ce4a6e9 tempest-AttachVolumeTestJSON-1344929934 None] Created volume successfully. Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Flow 'volume_create_manager' (3e57ec40-b1ae-46b7-aeb5-7af5469dc24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5970bb0d-5188-444f-9857-2a07ebd52f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5970bb0d-5188-444f-9857-2a07ebd52f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2055669626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6e8f65-0f35-45be-ae19-8ce9f489582b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4828968ce3ce4fdcad5bd9e29b606a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:39Z,use_quota=True,user_id='a70a1386b07a44f5be448fb83df91646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7cfabe9-9f8d-4a5a-a41b-281a644f5ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7cfabe9-9f8d-4a5a-a41b-281a644f5ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987cb50f-bf81-45cf-ac69-490e15992097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987cb50f-bf81-45cf-ac69-490e15992097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c6e8f65-0f35-45be-ae19-8ce9f489582b', 'volume_name': 'volume-9c6e8f65-0f35-45be-ae19-8ce9f489582b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff28610-add8-48f1-b767-e6387c5dacf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff28610-add8-48f1-b767-e6387c5dacf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffaace90-a2aa-4d47-ba09-40fc0d190285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Volume 9c6e8f65-0f35-45be-ae19-8ce9f489582b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c6e8f65-0f35-45be-ae19-8ce9f489582b', 'volume_size': 1} Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2055669626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6e8f65-0f35-45be-ae19-8ce9f489582b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4828968ce3ce4fdcad5bd9e29b606a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:39Z,use_quota=True,user_id='a70a1386b07a44f5be448fb83df91646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Creating volume 9c6e8f65-0f35-45be-ae19-8ce9f489582b {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:09:39 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:09:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9c6e8f65-0f35-45be-ae19-8ce9f489582b 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:39 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9c6e8f65-0f35-45be-ae19-8ce9f489582b 1073741824 Sep 01 12:09:39 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:40 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9c6e8f65-0f35-45be-ae19-8ce9f489582b 1073741824" returned: 0 in 0.633s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9c6e8f65-0f35-45be-ae19-8ce9f489582b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:40 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9c6e8f65-0f35-45be-ae19-8ce9f489582b Sep 01 12:09:40 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-e6c341ef-4d52-4a39-858f-a3e224876342 req-4c523600-709c-4370-90c9-7c67d2599667 tempest-AttachVolumeTestJSON-1344929934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:40 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9c6e8f65-0f35-45be-ae19-8ce9f489582b" returned: 0 in 0.347s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-e6c341ef-4d52-4a39-858f-a3e224876342 req-4c523600-709c-4370-90c9-7c67d2599667 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.236s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffaace90-a2aa-4d47-ba09-40fc0d190285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c6e8f65-0f35-45be-ae19-8ce9f489582b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1135eb18-3c34-425f-8b69-d567180af510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-e6c341ef-4d52-4a39-858f-a3e224876342 req-4c523600-709c-4370-90c9-7c67d2599667 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:40 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Volume volume-9c6e8f65-0f35-45be-ae19-8ce9f489582b (9c6e8f65-0f35-45be-ae19-8ce9f489582b): created successfully Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1135eb18-3c34-425f-8b69-d567180af510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Flow 'volume_create_manager' (3e57ec40-b1ae-46b7-aeb5-7af5469dc24d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:40 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f904946b-ef60-4872-94fc-048961b6836f tempest-VolumesActionsTest-468530088 None] Created volume successfully. Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-e6c341ef-4d52-4a39-858f-a3e224876342 req-4c523600-709c-4370-90c9-7c67d2599667 tempest-AttachVolumeTestJSON-1344929934 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-6469305b-1ba8-4e5a-b136-5a2b08ee9aec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2adf929a-eea2-45fb-80dc-67187b715630', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Flow 'volume_create_manager' (5a7a24f0-2bc8-427c-91d3-1a57f75cdbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd57ea47-c615-498c-ae6b-05bf63c66a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd57ea47-c615-498c-ae6b-05bf63c66a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1881097483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cdabd11-cbd2-4a6b-99f3-d473300d1735,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1b7ac01b04a415f8777e9c19b9bfacc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:41Z,use_quota=True,user_id='fc87e5b5289e48599f35aea416178409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb0402f-6b3d-4c3e-8ecc-e15080237d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb0402f-6b3d-4c3e-8ecc-e15080237d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1a5323-8574-4a4f-82d8-c97eb7c2056a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1a5323-8574-4a4f-82d8-c97eb7c2056a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cdabd11-cbd2-4a6b-99f3-d473300d1735', 'volume_name': 'volume-1cdabd11-cbd2-4a6b-99f3-d473300d1735', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5e557f-e08f-47d3-ba43-bb500ea86c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5e557f-e08f-47d3-ba43-bb500ea86c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e051192e-dc9e-4907-b52f-a13f31301f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:40 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Volume 1cdabd11-cbd2-4a6b-99f3-d473300d1735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cdabd11-cbd2-4a6b-99f3-d473300d1735', 'volume_size': 1} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1881097483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cdabd11-cbd2-4a6b-99f3-d473300d1735,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1b7ac01b04a415f8777e9c19b9bfacc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:41Z,use_quota=True,user_id='fc87e5b5289e48599f35aea416178409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Creating volume 1cdabd11-cbd2-4a6b-99f3-d473300d1735 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:09:40 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:09:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1cdabd11-cbd2-4a6b-99f3-d473300d1735 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:40 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-e6c341ef-4d52-4a39-858f-a3e224876342 req-4c523600-709c-4370-90c9-7c67d2599667 tempest-AttachVolumeTestJSON-1344929934 None] attachment_update completed successfully. Sep 01 12:09:40 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1cdabd11-cbd2-4a6b-99f3-d473300d1735 1073741824 Sep 01 12:09:40 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:41 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1cdabd11-cbd2-4a6b-99f3-d473300d1735 1073741824" returned: 0 in 0.618s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1cdabd11-cbd2-4a6b-99f3-d473300d1735 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:41 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1cdabd11-cbd2-4a6b-99f3-d473300d1735 Sep 01 12:09:41 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4814cf54-4845-47d4-8dcb-76e2f6bf954b tempest-VolumesActionsTest-1002036497 None] Acquiring lock "cinder-9c6e8f65-0f35-45be-ae19-8ce9f489582b-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:41 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1cdabd11-cbd2-4a6b-99f3-d473300d1735" returned: 0 in 0.325s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4814cf54-4845-47d4-8dcb-76e2f6bf954b tempest-VolumesActionsTest-1002036497 None] Lock "cinder-9c6e8f65-0f35-45be-ae19-8ce9f489582b-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:41 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e051192e-dc9e-4907-b52f-a13f31301f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cdabd11-cbd2-4a6b-99f3-d473300d1735', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:41 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf73908-012e-4f4b-a653-7dd43341856f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Volume volume-1cdabd11-cbd2-4a6b-99f3-d473300d1735 (1cdabd11-cbd2-4a6b-99f3-d473300d1735): created successfully Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf73908-012e-4f4b-a653-7dd43341856f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Flow 'volume_create_manager' (5a7a24f0-2bc8-427c-91d3-1a57f75cdbd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-628101ac-86a9-4b77-9de8-32d595fd4b77 req-0930cbaa-66d0-4273-8486-bee517bf2543 tempest-VolumesGetTestJSON-1438849515 None] Created volume successfully. Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4814cf54-4845-47d4-8dcb-76e2f6bf954b tempest-VolumesActionsTest-1002036497 None] Acquiring lock "cinder-quobyte-9c6e8f65-0f35-45be-ae19-8ce9f489582b" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4814cf54-4845-47d4-8dcb-76e2f6bf954b tempest-VolumesActionsTest-1002036497 None] Lock "cinder-quobyte-9c6e8f65-0f35-45be-ae19-8ce9f489582b" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9522ca2-2ca9-480b-9076-e24345ab9c35]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:09:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4814cf54-4845-47d4-8dcb-76e2f6bf954b tempest-VolumesActionsTest-1002036497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9c6e8f65-0f35-45be-ae19-8ce9f489582b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:42 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.314s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:09:42 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:09:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:09:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:09:42 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9c6e8f65-0f35-45be-ae19-8ce9f489582b Sep 01 12:09:42 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:42 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4814cf54-4845-47d4-8dcb-76e2f6bf954b tempest-VolumesActionsTest-1002036497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9c6e8f65-0f35-45be-ae19-8ce9f489582b" returned: 0 in 0.508s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4814cf54-4845-47d4-8dcb-76e2f6bf954b tempest-VolumesActionsTest-1002036497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9c6e8f65-0f35-45be-ae19-8ce9f489582b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:42 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9c6e8f65-0f35-45be-ae19-8ce9f489582b Sep 01 12:09:42 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:42 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4814cf54-4845-47d4-8dcb-76e2f6bf954b tempest-VolumesActionsTest-1002036497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9c6e8f65-0f35-45be-ae19-8ce9f489582b" returned: 0 in 0.355s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4814cf54-4845-47d4-8dcb-76e2f6bf954b tempest-VolumesActionsTest-1002036497 None] Lock "cinder-quobyte-9c6e8f65-0f35-45be-ae19-8ce9f489582b" released by "delete_volume" :: held 0.937s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:42 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-4814cf54-4845-47d4-8dcb-76e2f6bf954b tempest-VolumesActionsTest-1002036497 None] Created reservations ['e58a6293-0655-41c7-b321-99310b3b3991', '79ffad5b-b255-413a-8b60-eb71a55a5a38', '3d835472-0222-4de6-9ca4-d8cf711d4748', '188a9c41-4fb6-4c52-acbb-952a425e3227'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:09:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4814cf54-4845-47d4-8dcb-76e2f6bf954b tempest-VolumesActionsTest-1002036497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4814cf54-4845-47d4-8dcb-76e2f6bf954b tempest-VolumesActionsTest-1002036497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4814cf54-4845-47d4-8dcb-76e2f6bf954b tempest-VolumesActionsTest-1002036497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4814cf54-4845-47d4-8dcb-76e2f6bf954b tempest-VolumesActionsTest-1002036497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4814cf54-4845-47d4-8dcb-76e2f6bf954b tempest-VolumesActionsTest-1002036497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4814cf54-4845-47d4-8dcb-76e2f6bf954b tempest-VolumesActionsTest-1002036497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:43 devstack sudo[93656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:09:43 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-0f242ae4-747f-4466-a2a2-c07f4dbfb66f req-8a3d1c42-0ae5-4f35-9be1-2eae8af90603 tempest-VolumesGetTestJSON-1438849515 None] Acquiring lock "cinder-1cdabd11-cbd2-4a6b-99f3-d473300d1735-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-0f242ae4-747f-4466-a2a2-c07f4dbfb66f req-8a3d1c42-0ae5-4f35-9be1-2eae8af90603 tempest-VolumesGetTestJSON-1438849515 None] Lock "cinder-1cdabd11-cbd2-4a6b-99f3-d473300d1735-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-0f242ae4-747f-4466-a2a2-c07f4dbfb66f req-8a3d1c42-0ae5-4f35-9be1-2eae8af90603 tempest-VolumesGetTestJSON-1438849515 None] Acquiring lock "cinder-quobyte-1cdabd11-cbd2-4a6b-99f3-d473300d1735" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-a01a4339-cf85-4ddf-8b60-91ac14d3ccaa req-537d6f7d-553e-45ca-973e-3ac7462ec2f7 tempest-AttachVolumeTestJSON-1344929934 None] Terminate volume connection completed successfully. Sep 01 12:09:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-a01a4339-cf85-4ddf-8b60-91ac14d3ccaa req-537d6f7d-553e-45ca-973e-3ac7462ec2f7 tempest-AttachVolumeTestJSON-1344929934 None] Deleting attachment 5b059ba5-a53a-4a16-91f1-9e1e60d97d48. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:09:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-0f242ae4-747f-4466-a2a2-c07f4dbfb66f req-8a3d1c42-0ae5-4f35-9be1-2eae8af90603 tempest-VolumesGetTestJSON-1438849515 None] Lock "cinder-quobyte-1cdabd11-cbd2-4a6b-99f3-d473300d1735" acquired by "delete_volume" :: waited 0.039s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:43 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4814cf54-4845-47d4-8dcb-76e2f6bf954b tempest-VolumesActionsTest-1002036497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.300s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:43 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-4814cf54-4845-47d4-8dcb-76e2f6bf954b tempest-VolumesActionsTest-1002036497 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:09:43 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5142676d-a596-4c6a-a140-74e00add5e2d]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:09:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-0f242ae4-747f-4466-a2a2-c07f4dbfb66f req-8a3d1c42-0ae5-4f35-9be1-2eae8af90603 tempest-VolumesGetTestJSON-1438849515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1cdabd11-cbd2-4a6b-99f3-d473300d1735 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4814cf54-4845-47d4-8dcb-76e2f6bf954b tempest-VolumesActionsTest-1002036497 None] Deleted volume successfully. Sep 01 12:09:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4814cf54-4845-47d4-8dcb-76e2f6bf954b tempest-VolumesActionsTest-1002036497 None] Lock "cinder-9c6e8f65-0f35-45be-ae19-8ce9f489582b-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:43 devstack sudo[93661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1cdabd11-cbd2-4a6b-99f3-d473300d1735 Sep 01 12:09:43 devstack sudo[93661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:43 devstack sudo[93661]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-0f242ae4-747f-4466-a2a2-c07f4dbfb66f req-8a3d1c42-0ae5-4f35-9be1-2eae8af90603 tempest-VolumesGetTestJSON-1438849515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1cdabd11-cbd2-4a6b-99f3-d473300d1735" returned: 0 in 0.401s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-0f242ae4-747f-4466-a2a2-c07f4dbfb66f req-8a3d1c42-0ae5-4f35-9be1-2eae8af90603 tempest-VolumesGetTestJSON-1438849515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1cdabd11-cbd2-4a6b-99f3-d473300d1735 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:43 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1cdabd11-cbd2-4a6b-99f3-d473300d1735 Sep 01 12:09:43 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:44 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-0f242ae4-747f-4466-a2a2-c07f4dbfb66f req-8a3d1c42-0ae5-4f35-9be1-2eae8af90603 tempest-VolumesGetTestJSON-1438849515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1cdabd11-cbd2-4a6b-99f3-d473300d1735" returned: 0 in 0.271s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-0f242ae4-747f-4466-a2a2-c07f4dbfb66f req-8a3d1c42-0ae5-4f35-9be1-2eae8af90603 tempest-VolumesGetTestJSON-1438849515 None] Lock "cinder-quobyte-1cdabd11-cbd2-4a6b-99f3-d473300d1735" released by "delete_volume" :: held 0.735s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.quota [req-0f242ae4-747f-4466-a2a2-c07f4dbfb66f req-8a3d1c42-0ae5-4f35-9be1-2eae8af90603 tempest-VolumesGetTestJSON-1438849515 None] Created reservations ['e1a51879-d1de-4dbb-acc6-505e05fb55f9', 'b746c2ed-1d57-4778-b78e-6637801bb8bc', 'a40c75eb-8e4f-49d6-a89d-2c9fbeb24184', 'd377ead9-c9cf-4bf0-af89-24f87c703e72'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-0f242ae4-747f-4466-a2a2-c07f4dbfb66f req-8a3d1c42-0ae5-4f35-9be1-2eae8af90603 tempest-VolumesGetTestJSON-1438849515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-0f242ae4-747f-4466-a2a2-c07f4dbfb66f req-8a3d1c42-0ae5-4f35-9be1-2eae8af90603 tempest-VolumesGetTestJSON-1438849515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-0f242ae4-747f-4466-a2a2-c07f4dbfb66f req-8a3d1c42-0ae5-4f35-9be1-2eae8af90603 tempest-VolumesGetTestJSON-1438849515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-0f242ae4-747f-4466-a2a2-c07f4dbfb66f req-8a3d1c42-0ae5-4f35-9be1-2eae8af90603 tempest-VolumesGetTestJSON-1438849515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-0f242ae4-747f-4466-a2a2-c07f4dbfb66f req-8a3d1c42-0ae5-4f35-9be1-2eae8af90603 tempest-VolumesGetTestJSON-1438849515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-0f242ae4-747f-4466-a2a2-c07f4dbfb66f req-8a3d1c42-0ae5-4f35-9be1-2eae8af90603 tempest-VolumesGetTestJSON-1438849515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:44 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:09:44 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:44 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-0f242ae4-747f-4466-a2a2-c07f4dbfb66f req-8a3d1c42-0ae5-4f35-9be1-2eae8af90603 tempest-VolumesGetTestJSON-1438849515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.338s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.manager [req-0f242ae4-747f-4466-a2a2-c07f4dbfb66f req-8a3d1c42-0ae5-4f35-9be1-2eae8af90603 tempest-VolumesGetTestJSON-1438849515 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:09:44 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-0f242ae4-747f-4466-a2a2-c07f4dbfb66f req-8a3d1c42-0ae5-4f35-9be1-2eae8af90603 tempest-VolumesGetTestJSON-1438849515 None] Deleted volume successfully. Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-0f242ae4-747f-4466-a2a2-c07f4dbfb66f req-8a3d1c42-0ae5-4f35-9be1-2eae8af90603 tempest-VolumesGetTestJSON-1438849515 None] Lock "cinder-1cdabd11-cbd2-4a6b-99f3-d473300d1735-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:44 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-d9d3ae9e-3881-4bc9-9e77-cbc02bbfc6d0 req-ba2b523f-23dc-4d04-99ec-ca87f1c1b6fb tempest-AttachVolumeTestJSON-1344929934 None] Terminate volume connection completed successfully. Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-d9d3ae9e-3881-4bc9-9e77-cbc02bbfc6d0 req-ba2b523f-23dc-4d04-99ec-ca87f1c1b6fb tempest-AttachVolumeTestJSON-1344929934 None] Deleting attachment 2adf929a-eea2-45fb-80dc-67187b715630. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Flow 'volume_create_manager' (765a4b6c-fff7-4337-bff6-27a62d13c81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ad8e06-6902-4c9e-b409-5f2028e50c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ad8e06-6902-4c9e-b409-5f2028e50c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-29627119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a7c7be5-92ef-494d-a1a2-099072982142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4828968ce3ce4fdcad5bd9e29b606a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:45Z,use_quota=True,user_id='a70a1386b07a44f5be448fb83df91646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad58500e-df20-45c4-9f70-9b53ed561c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad58500e-df20-45c4-9f70-9b53ed561c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65bf5130-9f55-4b09-a190-c68e0c879331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65bf5130-9f55-4b09-a190-c68e0c879331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a7c7be5-92ef-494d-a1a2-099072982142', 'volume_name': 'volume-3a7c7be5-92ef-494d-a1a2-099072982142', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a36d0d-6bcc-4980-b90d-8fdaff8881d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a36d0d-6bcc-4980-b90d-8fdaff8881d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5a99fa-2ce8-42ac-b182-6e1a54bed31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:44 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Volume 3a7c7be5-92ef-494d-a1a2-099072982142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a7c7be5-92ef-494d-a1a2-099072982142', 'volume_size': 1} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-29627119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a7c7be5-92ef-494d-a1a2-099072982142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4828968ce3ce4fdcad5bd9e29b606a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:45Z,use_quota=True,user_id='a70a1386b07a44f5be448fb83df91646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Creating volume 3a7c7be5-92ef-494d-a1a2-099072982142 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:09:44 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:09:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a7c7be5-92ef-494d-a1a2-099072982142 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:44 devstack sudo[93676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a7c7be5-92ef-494d-a1a2-099072982142 1073741824 Sep 01 12:09:44 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:45 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a7c7be5-92ef-494d-a1a2-099072982142 1073741824" returned: 0 in 0.453s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a7c7be5-92ef-494d-a1a2-099072982142 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:45 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a7c7be5-92ef-494d-a1a2-099072982142 Sep 01 12:09:45 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:45 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a7c7be5-92ef-494d-a1a2-099072982142" returned: 0 in 0.322s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:09:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5a99fa-2ce8-42ac-b182-6e1a54bed31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a7c7be5-92ef-494d-a1a2-099072982142', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30eec267-b4e4-4782-9049-9005dddeb823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:45 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Volume volume-3a7c7be5-92ef-494d-a1a2-099072982142 (3a7c7be5-92ef-494d-a1a2-099072982142): created successfully Sep 01 12:09:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30eec267-b4e4-4782-9049-9005dddeb823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Flow 'volume_create_manager' (765a4b6c-fff7-4337-bff6-27a62d13c81a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-95f152a1-e0cc-4b51-beae-dab334832ead tempest-VolumesActionsTest-468530088 None] Created volume successfully. Sep 01 12:09:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-be32a083-13d2-4421-bf3e-7b610f65417c tempest-VolumesActionsTest-1002036497 None] Acquiring lock "cinder-3a7c7be5-92ef-494d-a1a2-099072982142-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-be32a083-13d2-4421-bf3e-7b610f65417c tempest-VolumesActionsTest-1002036497 None] Lock "cinder-3a7c7be5-92ef-494d-a1a2-099072982142-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-be32a083-13d2-4421-bf3e-7b610f65417c tempest-VolumesActionsTest-1002036497 None] Acquiring lock "cinder-quobyte-3a7c7be5-92ef-494d-a1a2-099072982142" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-be32a083-13d2-4421-bf3e-7b610f65417c tempest-VolumesActionsTest-1002036497 None] Lock "cinder-quobyte-3a7c7be5-92ef-494d-a1a2-099072982142" acquired by "delete_volume" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:47 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cc096f-966a-4d22-bac5-7f8a10d75abc]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:09:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-be32a083-13d2-4421-bf3e-7b610f65417c tempest-VolumesActionsTest-1002036497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a7c7be5-92ef-494d-a1a2-099072982142 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:47 devstack sudo[93709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a7c7be5-92ef-494d-a1a2-099072982142 Sep 01 12:09:47 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:47 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-be32a083-13d2-4421-bf3e-7b610f65417c tempest-VolumesActionsTest-1002036497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a7c7be5-92ef-494d-a1a2-099072982142" returned: 0 in 0.467s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-be32a083-13d2-4421-bf3e-7b610f65417c tempest-VolumesActionsTest-1002036497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a7c7be5-92ef-494d-a1a2-099072982142 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:47 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a7c7be5-92ef-494d-a1a2-099072982142 Sep 01 12:09:47 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:47 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-be32a083-13d2-4421-bf3e-7b610f65417c tempest-VolumesActionsTest-1002036497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a7c7be5-92ef-494d-a1a2-099072982142" returned: 0 in 0.318s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-be32a083-13d2-4421-bf3e-7b610f65417c tempest-VolumesActionsTest-1002036497 None] Lock "cinder-quobyte-3a7c7be5-92ef-494d-a1a2-099072982142" released by "delete_volume" :: held 0.847s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-be32a083-13d2-4421-bf3e-7b610f65417c tempest-VolumesActionsTest-1002036497 None] Created reservations ['7c4f1ace-f22e-44bc-ba7d-f35d9b13e50f', '026f0d27-03a6-4f63-852a-b93176c06556', 'd44d8ce4-b21f-4a87-b397-09a7ebafe47c', '4a41a79d-c21e-4f5e-995b-2868062eef95'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-be32a083-13d2-4421-bf3e-7b610f65417c tempest-VolumesActionsTest-1002036497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-be32a083-13d2-4421-bf3e-7b610f65417c tempest-VolumesActionsTest-1002036497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-be32a083-13d2-4421-bf3e-7b610f65417c tempest-VolumesActionsTest-1002036497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-be32a083-13d2-4421-bf3e-7b610f65417c tempest-VolumesActionsTest-1002036497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-be32a083-13d2-4421-bf3e-7b610f65417c tempest-VolumesActionsTest-1002036497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-be32a083-13d2-4421-bf3e-7b610f65417c tempest-VolumesActionsTest-1002036497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:48 devstack sudo[93720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:09:48 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:48 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-be32a083-13d2-4421-bf3e-7b610f65417c tempest-VolumesActionsTest-1002036497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.366s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-be32a083-13d2-4421-bf3e-7b610f65417c tempest-VolumesActionsTest-1002036497 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:09:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-be32a083-13d2-4421-bf3e-7b610f65417c tempest-VolumesActionsTest-1002036497 None] Deleted volume successfully. Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-be32a083-13d2-4421-bf3e-7b610f65417c tempest-VolumesActionsTest-1002036497 None] Lock "cinder-3a7c7be5-92ef-494d-a1a2-099072982142-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Flow 'volume_create_manager' (eb0ffacc-482b-46c1-b611-57e00e86e8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11325ff1-34ed-47a6-8627-6d32921bfd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11325ff1-34ed-47a6-8627-6d32921bfd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-684965097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e09071b-df2c-40b4-9643-98737aba0604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4828968ce3ce4fdcad5bd9e29b606a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:49Z,use_quota=True,user_id='a70a1386b07a44f5be448fb83df91646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac18675-4287-4942-a591-fc9d2450616f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac18675-4287-4942-a591-fc9d2450616f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b3979b-fa82-4f71-8307-5e64c3f4ea46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b3979b-fa82-4f71-8307-5e64c3f4ea46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e09071b-df2c-40b4-9643-98737aba0604', 'volume_name': 'volume-7e09071b-df2c-40b4-9643-98737aba0604', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d9ef280-8ef0-4b54-ae3c-1f8f815c7544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d9ef280-8ef0-4b54-ae3c-1f8f815c7544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963e1df5-4860-4f9e-abdb-5d44cbe0489f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:48 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Volume 7e09071b-df2c-40b4-9643-98737aba0604: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e09071b-df2c-40b4-9643-98737aba0604', 'volume_size': 1} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-684965097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e09071b-df2c-40b4-9643-98737aba0604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4828968ce3ce4fdcad5bd9e29b606a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:09:49Z,use_quota=True,user_id='a70a1386b07a44f5be448fb83df91646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Creating volume 7e09071b-df2c-40b4-9643-98737aba0604 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:09:48 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:09:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7e09071b-df2c-40b4-9643-98737aba0604 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:48 devstack sudo[93723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7e09071b-df2c-40b4-9643-98737aba0604 1073741824 Sep 01 12:09:48 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-97f9d3b4-517f-46c9-8fff-75610acb07ed tempest-BackendsCapabilitiesAdminTestsJSON-1626621924 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9639739990234, 'free_capacity_gb': 1773.9639739990234, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87084) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 12:09:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18440496-b81c-4ca8-aa91-6fa8f2ac284b tempest-BackendsCapabilitiesAdminTestsJSON-1626621924 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9639739990234, 'free_capacity_gb': 1773.9639739990234, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87084) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 12:09:49 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7e09071b-df2c-40b4-9643-98737aba0604 1073741824" returned: 0 in 0.602s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7e09071b-df2c-40b4-9643-98737aba0604 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:49 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7e09071b-df2c-40b4-9643-98737aba0604 Sep 01 12:09:49 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:49 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7e09071b-df2c-40b4-9643-98737aba0604" returned: 0 in 0.296s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:09:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963e1df5-4860-4f9e-abdb-5d44cbe0489f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e09071b-df2c-40b4-9643-98737aba0604', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d83c6bf-c5a4-4039-89f8-395a86ec36c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:09:49 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Volume volume-7e09071b-df2c-40b4-9643-98737aba0604 (7e09071b-df2c-40b4-9643-98737aba0604): created successfully Sep 01 12:09:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d83c6bf-c5a4-4039-89f8-395a86ec36c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:09:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Flow 'volume_create_manager' (eb0ffacc-482b-46c1-b611-57e00e86e8d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:09:49 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-277fe7a8-830c-4ddc-ac4e-5dfba3d81386 tempest-VolumesActionsTest-468530088 None] Created volume successfully. Sep 01 12:09:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5cca06bc-3999-4e70-bcf3-d730e6aec8e8 tempest-AttachVolumeTestJSON-1344929934 None] Acquiring lock "cinder-6469305b-1ba8-4e5a-b136-5a2b08ee9aec-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5cca06bc-3999-4e70-bcf3-d730e6aec8e8 tempest-AttachVolumeTestJSON-1344929934 None] Lock "cinder-6469305b-1ba8-4e5a-b136-5a2b08ee9aec-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5cca06bc-3999-4e70-bcf3-d730e6aec8e8 tempest-AttachVolumeTestJSON-1344929934 None] Acquiring lock "cinder-quobyte-6469305b-1ba8-4e5a-b136-5a2b08ee9aec" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5cca06bc-3999-4e70-bcf3-d730e6aec8e8 tempest-AttachVolumeTestJSON-1344929934 None] Lock "cinder-quobyte-6469305b-1ba8-4e5a-b136-5a2b08ee9aec" acquired by "delete_volume" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:50 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ae8129-cc78-4c96-a096-e5e86b476f15]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:09:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5cca06bc-3999-4e70-bcf3-d730e6aec8e8 tempest-AttachVolumeTestJSON-1344929934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6469305b-1ba8-4e5a-b136-5a2b08ee9aec {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:50 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6469305b-1ba8-4e5a-b136-5a2b08ee9aec Sep 01 12:09:50 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:50 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5cca06bc-3999-4e70-bcf3-d730e6aec8e8 tempest-AttachVolumeTestJSON-1344929934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6469305b-1ba8-4e5a-b136-5a2b08ee9aec" returned: 0 in 0.453s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5cca06bc-3999-4e70-bcf3-d730e6aec8e8 tempest-AttachVolumeTestJSON-1344929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6469305b-1ba8-4e5a-b136-5a2b08ee9aec {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:50 devstack sudo[93739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6469305b-1ba8-4e5a-b136-5a2b08ee9aec Sep 01 12:09:50 devstack sudo[93739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:50 devstack sudo[93739]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5cca06bc-3999-4e70-bcf3-d730e6aec8e8 tempest-AttachVolumeTestJSON-1344929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6469305b-1ba8-4e5a-b136-5a2b08ee9aec" returned: 0 in 0.314s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5cca06bc-3999-4e70-bcf3-d730e6aec8e8 tempest-AttachVolumeTestJSON-1344929934 None] Lock "cinder-quobyte-6469305b-1ba8-4e5a-b136-5a2b08ee9aec" released by "delete_volume" :: held 0.821s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:50 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-5cca06bc-3999-4e70-bcf3-d730e6aec8e8 tempest-AttachVolumeTestJSON-1344929934 None] Created reservations ['b2a048a4-ff75-456f-970e-4ce1da6df044', '2f588d66-6711-42cb-9aef-8b81e1a94eb4', '57f41ed9-c6de-4a48-9619-06b4e5e7980e', 'f7136b40-d930-41ec-9d2d-3690cd5ab25f'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:09:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5cca06bc-3999-4e70-bcf3-d730e6aec8e8 tempest-AttachVolumeTestJSON-1344929934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5cca06bc-3999-4e70-bcf3-d730e6aec8e8 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5cca06bc-3999-4e70-bcf3-d730e6aec8e8 tempest-AttachVolumeTestJSON-1344929934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5cca06bc-3999-4e70-bcf3-d730e6aec8e8 tempest-AttachVolumeTestJSON-1344929934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5cca06bc-3999-4e70-bcf3-d730e6aec8e8 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5cca06bc-3999-4e70-bcf3-d730e6aec8e8 tempest-AttachVolumeTestJSON-1344929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:51 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:09:51 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-551fd724-c0fd-4fac-8071-9bbbc7f33ba3 tempest-AttachVolumeTestJSON-1344929934 None] Acquiring lock "cinder-23405ce4-7e87-4078-94e0-1da38dd49aa4-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-551fd724-c0fd-4fac-8071-9bbbc7f33ba3 tempest-AttachVolumeTestJSON-1344929934 None] Lock "cinder-23405ce4-7e87-4078-94e0-1da38dd49aa4-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-551fd724-c0fd-4fac-8071-9bbbc7f33ba3 tempest-AttachVolumeTestJSON-1344929934 None] Acquiring lock "cinder-quobyte-23405ce4-7e87-4078-94e0-1da38dd49aa4" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-551fd724-c0fd-4fac-8071-9bbbc7f33ba3 tempest-AttachVolumeTestJSON-1344929934 None] Lock "cinder-quobyte-23405ce4-7e87-4078-94e0-1da38dd49aa4" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:51 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[52137ae2-ff6f-41da-a43d-a84904acb67a]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:09:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-551fd724-c0fd-4fac-8071-9bbbc7f33ba3 tempest-AttachVolumeTestJSON-1344929934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-23405ce4-7e87-4078-94e0-1da38dd49aa4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:51 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5cca06bc-3999-4e70-bcf3-d730e6aec8e8 tempest-AttachVolumeTestJSON-1344929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.459s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:51 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-5cca06bc-3999-4e70-bcf3-d730e6aec8e8 tempest-AttachVolumeTestJSON-1344929934 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:09:51 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5cca06bc-3999-4e70-bcf3-d730e6aec8e8 tempest-AttachVolumeTestJSON-1344929934 None] Deleted volume successfully. Sep 01 12:09:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5cca06bc-3999-4e70-bcf3-d730e6aec8e8 tempest-AttachVolumeTestJSON-1344929934 None] Lock "cinder-6469305b-1ba8-4e5a-b136-5a2b08ee9aec-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:51 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-23405ce4-7e87-4078-94e0-1da38dd49aa4 Sep 01 12:09:51 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e9cab041-e5d4-4024-9feb-24850a74bb0f tempest-VolumesActionsTest-468530088 None] Acquiring lock "cinder-7e09071b-df2c-40b4-9643-98737aba0604-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e9cab041-e5d4-4024-9feb-24850a74bb0f tempest-VolumesActionsTest-468530088 None] Lock "cinder-7e09071b-df2c-40b4-9643-98737aba0604-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e9cab041-e5d4-4024-9feb-24850a74bb0f tempest-VolumesActionsTest-468530088 None] Acquiring lock "cinder-quobyte-7e09071b-df2c-40b4-9643-98737aba0604" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e9cab041-e5d4-4024-9feb-24850a74bb0f tempest-VolumesActionsTest-468530088 None] Lock "cinder-quobyte-7e09071b-df2c-40b4-9643-98737aba0604" acquired by "delete_volume" :: waited 0.052s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:52 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-551fd724-c0fd-4fac-8071-9bbbc7f33ba3 tempest-AttachVolumeTestJSON-1344929934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-23405ce4-7e87-4078-94e0-1da38dd49aa4" returned: 0 in 0.685s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-551fd724-c0fd-4fac-8071-9bbbc7f33ba3 tempest-AttachVolumeTestJSON-1344929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-23405ce4-7e87-4078-94e0-1da38dd49aa4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:52 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b4f17e-3382-4707-bb04-2f8054f29583]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:09:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e9cab041-e5d4-4024-9feb-24850a74bb0f tempest-VolumesActionsTest-468530088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7e09071b-df2c-40b4-9643-98737aba0604 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:52 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-23405ce4-7e87-4078-94e0-1da38dd49aa4 Sep 01 12:09:52 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:52 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7e09071b-df2c-40b4-9643-98737aba0604 Sep 01 12:09:52 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:52 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-551fd724-c0fd-4fac-8071-9bbbc7f33ba3 tempest-AttachVolumeTestJSON-1344929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-23405ce4-7e87-4078-94e0-1da38dd49aa4" returned: 0 in 0.473s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-551fd724-c0fd-4fac-8071-9bbbc7f33ba3 tempest-AttachVolumeTestJSON-1344929934 None] Lock "cinder-quobyte-23405ce4-7e87-4078-94e0-1da38dd49aa4" released by "delete_volume" :: held 1.243s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:52 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-551fd724-c0fd-4fac-8071-9bbbc7f33ba3 tempest-AttachVolumeTestJSON-1344929934 None] Created reservations ['7ee2b452-5424-4735-b08a-3cf9c6d68197', 'aa89e2f7-6b7d-46b7-a7a6-5b30685537bc', '42de85c7-1561-4a87-9948-86180cc81f2a', 'ae94d7c7-3811-4e36-9976-498678040541'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:09:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-551fd724-c0fd-4fac-8071-9bbbc7f33ba3 tempest-AttachVolumeTestJSON-1344929934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-551fd724-c0fd-4fac-8071-9bbbc7f33ba3 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-551fd724-c0fd-4fac-8071-9bbbc7f33ba3 tempest-AttachVolumeTestJSON-1344929934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-551fd724-c0fd-4fac-8071-9bbbc7f33ba3 tempest-AttachVolumeTestJSON-1344929934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-551fd724-c0fd-4fac-8071-9bbbc7f33ba3 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-551fd724-c0fd-4fac-8071-9bbbc7f33ba3 tempest-AttachVolumeTestJSON-1344929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:52 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:09:52 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:52 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e9cab041-e5d4-4024-9feb-24850a74bb0f tempest-VolumesActionsTest-468530088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7e09071b-df2c-40b4-9643-98737aba0604" returned: 0 in 0.670s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e9cab041-e5d4-4024-9feb-24850a74bb0f tempest-VolumesActionsTest-468530088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7e09071b-df2c-40b4-9643-98737aba0604 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:52 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7e09071b-df2c-40b4-9643-98737aba0604 Sep 01 12:09:52 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:53 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e9cab041-e5d4-4024-9feb-24850a74bb0f tempest-VolumesActionsTest-468530088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7e09071b-df2c-40b4-9643-98737aba0604" returned: 0 in 0.445s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e9cab041-e5d4-4024-9feb-24850a74bb0f tempest-VolumesActionsTest-468530088 None] Lock "cinder-quobyte-7e09071b-df2c-40b4-9643-98737aba0604" released by "delete_volume" :: held 1.219s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:53 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-551fd724-c0fd-4fac-8071-9bbbc7f33ba3 tempest-AttachVolumeTestJSON-1344929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.595s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-551fd724-c0fd-4fac-8071-9bbbc7f33ba3 tempest-AttachVolumeTestJSON-1344929934 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:09:53 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-551fd724-c0fd-4fac-8071-9bbbc7f33ba3 tempest-AttachVolumeTestJSON-1344929934 None] Deleted volume successfully. Sep 01 12:09:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-551fd724-c0fd-4fac-8071-9bbbc7f33ba3 tempest-AttachVolumeTestJSON-1344929934 None] Lock "cinder-23405ce4-7e87-4078-94e0-1da38dd49aa4-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:53 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-e9cab041-e5d4-4024-9feb-24850a74bb0f tempest-VolumesActionsTest-468530088 None] Created reservations ['9a3a9aff-1c20-4bb3-8a2b-5c91eea19501', '06142ad5-3b91-4df9-8512-8cc5f122ee9f', 'e651aaa3-2282-405d-9884-33b55e5b5fe2', 'f26e557b-05ac-4017-8961-d441a16f99ec'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:09:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e9cab041-e5d4-4024-9feb-24850a74bb0f tempest-VolumesActionsTest-468530088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e9cab041-e5d4-4024-9feb-24850a74bb0f tempest-VolumesActionsTest-468530088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e9cab041-e5d4-4024-9feb-24850a74bb0f tempest-VolumesActionsTest-468530088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e9cab041-e5d4-4024-9feb-24850a74bb0f tempest-VolumesActionsTest-468530088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e9cab041-e5d4-4024-9feb-24850a74bb0f tempest-VolumesActionsTest-468530088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e9cab041-e5d4-4024-9feb-24850a74bb0f tempest-VolumesActionsTest-468530088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:53 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:09:53 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-26ce3589-0aa2-4520-85ff-2ee29ee51649 tempest-AttachVolumeTestJSON-1344929934 None] Acquiring lock "cinder-ad19e43e-910c-44da-b384-4c81f081e81e-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-26ce3589-0aa2-4520-85ff-2ee29ee51649 tempest-AttachVolumeTestJSON-1344929934 None] Lock "cinder-ad19e43e-910c-44da-b384-4c81f081e81e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-26ce3589-0aa2-4520-85ff-2ee29ee51649 tempest-AttachVolumeTestJSON-1344929934 None] Acquiring lock "cinder-quobyte-ad19e43e-910c-44da-b384-4c81f081e81e" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-26ce3589-0aa2-4520-85ff-2ee29ee51649 tempest-AttachVolumeTestJSON-1344929934 None] Lock "cinder-quobyte-ad19e43e-910c-44da-b384-4c81f081e81e" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:53 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda2a8ee-bafb-4f29-803d-9e1fe08f959a]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:09:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26ce3589-0aa2-4520-85ff-2ee29ee51649 tempest-AttachVolumeTestJSON-1344929934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ad19e43e-910c-44da-b384-4c81f081e81e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:53 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e9cab041-e5d4-4024-9feb-24850a74bb0f tempest-VolumesActionsTest-468530088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.457s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-e9cab041-e5d4-4024-9feb-24850a74bb0f tempest-VolumesActionsTest-468530088 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:09:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e9cab041-e5d4-4024-9feb-24850a74bb0f tempest-VolumesActionsTest-468530088 None] Deleted volume successfully. Sep 01 12:09:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e9cab041-e5d4-4024-9feb-24850a74bb0f tempest-VolumesActionsTest-468530088 None] Lock "cinder-7e09071b-df2c-40b4-9643-98737aba0604-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:54 devstack sudo[93800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ad19e43e-910c-44da-b384-4c81f081e81e Sep 01 12:09:54 devstack sudo[93800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:54 devstack sudo[93800]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26ce3589-0aa2-4520-85ff-2ee29ee51649 tempest-AttachVolumeTestJSON-1344929934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ad19e43e-910c-44da-b384-4c81f081e81e" returned: 0 in 0.525s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26ce3589-0aa2-4520-85ff-2ee29ee51649 tempest-AttachVolumeTestJSON-1344929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ad19e43e-910c-44da-b384-4c81f081e81e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:54 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ad19e43e-910c-44da-b384-4c81f081e81e Sep 01 12:09:54 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-5972e9e3-29ba-4d63-94ba-0fd5261b9744 tempest-ServerActionsTestOtherA-1571640185 None] Terminate volume connection completed successfully. Sep 01 12:09:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-5972e9e3-29ba-4d63-94ba-0fd5261b9744 tempest-ServerActionsTestOtherA-1571640185 None] Deleting attachment 469e6180-bbb1-40fc-a338-41c3968a8d38. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:09:54 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26ce3589-0aa2-4520-85ff-2ee29ee51649 tempest-AttachVolumeTestJSON-1344929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ad19e43e-910c-44da-b384-4c81f081e81e" returned: 0 in 0.347s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-26ce3589-0aa2-4520-85ff-2ee29ee51649 tempest-AttachVolumeTestJSON-1344929934 None] Lock "cinder-quobyte-ad19e43e-910c-44da-b384-4c81f081e81e" released by "delete_volume" :: held 0.939s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:54 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-26ce3589-0aa2-4520-85ff-2ee29ee51649 tempest-AttachVolumeTestJSON-1344929934 None] Created reservations ['5180a04a-8ecc-450c-af93-c4c8eebd8992', '9b28e118-76cc-4cbe-9b47-5592283d9ffc', '667c985a-3b4d-4871-9df9-1c9910bc0681', 'fc59b78f-9aac-495c-ae33-3d64c81b06bd'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:09:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-26ce3589-0aa2-4520-85ff-2ee29ee51649 tempest-AttachVolumeTestJSON-1344929934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-26ce3589-0aa2-4520-85ff-2ee29ee51649 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-26ce3589-0aa2-4520-85ff-2ee29ee51649 tempest-AttachVolumeTestJSON-1344929934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-26ce3589-0aa2-4520-85ff-2ee29ee51649 tempest-AttachVolumeTestJSON-1344929934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-26ce3589-0aa2-4520-85ff-2ee29ee51649 tempest-AttachVolumeTestJSON-1344929934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26ce3589-0aa2-4520-85ff-2ee29ee51649 tempest-AttachVolumeTestJSON-1344929934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-e833bdfa-3c06-4de2-be05-5495626fa945 tempest-ServerActionsTestOtherA-1571640185 None] Acquiring lock "cinder-14352247-b51d-46cd-a02c-5a68bdc2ee51-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:55 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:09:55 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-e833bdfa-3c06-4de2-be05-5495626fa945 tempest-ServerActionsTestOtherA-1571640185 None] Lock "cinder-14352247-b51d-46cd-a02c-5a68bdc2ee51-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-e833bdfa-3c06-4de2-be05-5495626fa945 tempest-ServerActionsTestOtherA-1571640185 None] Acquiring lock "cinder-quobyte-14352247-b51d-46cd-a02c-5a68bdc2ee51" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-e833bdfa-3c06-4de2-be05-5495626fa945 tempest-ServerActionsTestOtherA-1571640185 None] Lock "cinder-quobyte-14352247-b51d-46cd-a02c-5a68bdc2ee51" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:55 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fc420d-ecb9-4d37-b54b-5e6c9c5deab1]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:09:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-e833bdfa-3c06-4de2-be05-5495626fa945 tempest-ServerActionsTestOtherA-1571640185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-14352247-b51d-46cd-a02c-5a68bdc2ee51 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:55 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-14352247-b51d-46cd-a02c-5a68bdc2ee51 Sep 01 12:09:55 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:55 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26ce3589-0aa2-4520-85ff-2ee29ee51649 tempest-AttachVolumeTestJSON-1344929934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.486s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:55 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-26ce3589-0aa2-4520-85ff-2ee29ee51649 tempest-AttachVolumeTestJSON-1344929934 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:09:55 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-26ce3589-0aa2-4520-85ff-2ee29ee51649 tempest-AttachVolumeTestJSON-1344929934 None] Deleted volume successfully. Sep 01 12:09:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-26ce3589-0aa2-4520-85ff-2ee29ee51649 tempest-AttachVolumeTestJSON-1344929934 None] Lock "cinder-ad19e43e-910c-44da-b384-4c81f081e81e-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:55 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-e833bdfa-3c06-4de2-be05-5495626fa945 tempest-ServerActionsTestOtherA-1571640185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-14352247-b51d-46cd-a02c-5a68bdc2ee51" returned: 0 in 0.533s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-e833bdfa-3c06-4de2-be05-5495626fa945 tempest-ServerActionsTestOtherA-1571640185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-14352247-b51d-46cd-a02c-5a68bdc2ee51 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:55 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-14352247-b51d-46cd-a02c-5a68bdc2ee51 Sep 01 12:09:55 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:56 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-e833bdfa-3c06-4de2-be05-5495626fa945 tempest-ServerActionsTestOtherA-1571640185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-14352247-b51d-46cd-a02c-5a68bdc2ee51" returned: 0 in 0.278s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-e833bdfa-3c06-4de2-be05-5495626fa945 tempest-ServerActionsTestOtherA-1571640185 None] Lock "cinder-quobyte-14352247-b51d-46cd-a02c-5a68bdc2ee51" released by "delete_volume" :: held 0.889s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:56 devstack cinder-volume[87084]: DEBUG cinder.quota [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-e833bdfa-3c06-4de2-be05-5495626fa945 tempest-ServerActionsTestOtherA-1571640185 None] Created reservations ['ca7b89f0-74d0-4ea3-8eb3-82086b764f32', 'f74f2923-3e6d-49e5-882f-ece6d9b5e6eb', 'fc57f24a-7e06-4b67-ac91-3ef5effec85c', '7978866b-1468-47cd-a3df-8776a4c4e06d'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:09:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-e833bdfa-3c06-4de2-be05-5495626fa945 tempest-ServerActionsTestOtherA-1571640185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-e833bdfa-3c06-4de2-be05-5495626fa945 tempest-ServerActionsTestOtherA-1571640185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-e833bdfa-3c06-4de2-be05-5495626fa945 tempest-ServerActionsTestOtherA-1571640185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-e833bdfa-3c06-4de2-be05-5495626fa945 tempest-ServerActionsTestOtherA-1571640185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-e833bdfa-3c06-4de2-be05-5495626fa945 tempest-ServerActionsTestOtherA-1571640185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-e833bdfa-3c06-4de2-be05-5495626fa945 tempest-ServerActionsTestOtherA-1571640185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:56 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:09:56 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:56 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-e833bdfa-3c06-4de2-be05-5495626fa945 tempest-ServerActionsTestOtherA-1571640185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.337s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:56 devstack cinder-volume[87084]: DEBUG cinder.manager [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-e833bdfa-3c06-4de2-be05-5495626fa945 tempest-ServerActionsTestOtherA-1571640185 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:09:56 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-e833bdfa-3c06-4de2-be05-5495626fa945 tempest-ServerActionsTestOtherA-1571640185 None] Deleted volume successfully. Sep 01 12:09:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-52a2f6e3-4c76-4ca0-8f80-91d6eeb13253 req-e833bdfa-3c06-4de2-be05-5495626fa945 tempest-ServerActionsTestOtherA-1571640185 None] Lock "cinder-14352247-b51d-46cd-a02c-5a68bdc2ee51-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b430e0df-5f5a-4605-9115-1b40ff6a8641 tempest-ServerActionsTestOtherA-1571640185 None] Acquiring lock "cinder-95307a56-7b23-44f6-927d-e098de01f204-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b430e0df-5f5a-4605-9115-1b40ff6a8641 tempest-ServerActionsTestOtherA-1571640185 None] Lock "cinder-95307a56-7b23-44f6-927d-e098de01f204-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b430e0df-5f5a-4605-9115-1b40ff6a8641 tempest-ServerActionsTestOtherA-1571640185 None] Acquiring lock "cinder-quobyte-95307a56-7b23-44f6-927d-e098de01f204" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:09:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b430e0df-5f5a-4605-9115-1b40ff6a8641 tempest-ServerActionsTestOtherA-1571640185 None] Lock "cinder-quobyte-95307a56-7b23-44f6-927d-e098de01f204" acquired by "delete_volume" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:09:57 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef7452a-b38d-4205-a30c-d23c80873765]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:09:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b430e0df-5f5a-4605-9115-1b40ff6a8641 tempest-ServerActionsTestOtherA-1571640185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-95307a56-7b23-44f6-927d-e098de01f204 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:57 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-95307a56-7b23-44f6-927d-e098de01f204 Sep 01 12:09:57 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:57 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b430e0df-5f5a-4605-9115-1b40ff6a8641 tempest-ServerActionsTestOtherA-1571640185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-95307a56-7b23-44f6-927d-e098de01f204" returned: 0 in 0.532s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b430e0df-5f5a-4605-9115-1b40ff6a8641 tempest-ServerActionsTestOtherA-1571640185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-95307a56-7b23-44f6-927d-e098de01f204 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:57 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-95307a56-7b23-44f6-927d-e098de01f204 Sep 01 12:09:57 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:58 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b430e0df-5f5a-4605-9115-1b40ff6a8641 tempest-ServerActionsTestOtherA-1571640185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-95307a56-7b23-44f6-927d-e098de01f204" returned: 0 in 0.397s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b430e0df-5f5a-4605-9115-1b40ff6a8641 tempest-ServerActionsTestOtherA-1571640185 None] Lock "cinder-quobyte-95307a56-7b23-44f6-927d-e098de01f204" released by "delete_volume" :: held 0.985s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:09:58 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-b430e0df-5f5a-4605-9115-1b40ff6a8641 tempest-ServerActionsTestOtherA-1571640185 None] Created reservations ['48b7f96b-44c4-4933-bd0c-aaafe4eff4dd', '2930cf84-7679-4dd0-8c17-3a86a56c69ff', '0a1cfbbf-a730-42a6-a44f-7dae8010e190', 'e45be3ae-6042-42c8-b567-5d0cc3d2b871'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:09:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b430e0df-5f5a-4605-9115-1b40ff6a8641 tempest-ServerActionsTestOtherA-1571640185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:09:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b430e0df-5f5a-4605-9115-1b40ff6a8641 tempest-ServerActionsTestOtherA-1571640185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:09:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b430e0df-5f5a-4605-9115-1b40ff6a8641 tempest-ServerActionsTestOtherA-1571640185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:09:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b430e0df-5f5a-4605-9115-1b40ff6a8641 tempest-ServerActionsTestOtherA-1571640185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:09:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b430e0df-5f5a-4605-9115-1b40ff6a8641 tempest-ServerActionsTestOtherA-1571640185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:09:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b430e0df-5f5a-4605-9115-1b40ff6a8641 tempest-ServerActionsTestOtherA-1571640185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:09:58 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:09:58 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:09:58 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Sep 01 12:09:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b430e0df-5f5a-4605-9115-1b40ff6a8641 tempest-ServerActionsTestOtherA-1571640185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.278s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:09:58 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b430e0df-5f5a-4605-9115-1b40ff6a8641 tempest-ServerActionsTestOtherA-1571640185 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:09:58 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b430e0df-5f5a-4605-9115-1b40ff6a8641 tempest-ServerActionsTestOtherA-1571640185 None] Deleted volume successfully. Sep 01 12:09:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b430e0df-5f5a-4605-9115-1b40ff6a8641 tempest-ServerActionsTestOtherA-1571640185 None] Lock "cinder-95307a56-7b23-44f6-927d-e098de01f204-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:10:05 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=156,cinder:SELECT=120,cinder:INSERT=29,cinder:DELETE=13 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:10:05 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e0215a27-ec1e-4e8f-a1c6-b41fe31caf81 tempest-GroupsV314Test-1405099939 None] Group tempest-GroupsV314Test-Group-403437123: creating Sep 01 12:10:05 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=129,cinder:UPDATE=151,cinder:INSERT=40,cinder:DELETE=12 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:10:05 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e0215a27-ec1e-4e8f-a1c6-b41fe31caf81 tempest-GroupsV314Test-1405099939 None] Group tempest-GroupsV314Test-Group-403437123: created successfully Sep 01 12:10:05 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e0215a27-ec1e-4e8f-a1c6-b41fe31caf81 tempest-GroupsV314Test-1405099939 None] Create group completed successfully. Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Flow 'volume_create_manager' (f168f1af-330c-46e2-8310-7d3c38b9b758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd4d77d-1042-486b-843c-30a9b29427b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd4d77d-1042-486b-843c-30a9b29427b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1753056409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2eca8c10-f700-410d-a578-25ece2425539,host='devstack@QuobyteHD#QuobyteHD',id=79e968fd-d82e-400a-9dfc-e02a256170c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba80b858616e4e44851019dfe96d583b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:10:08Z,use_quota=True,user_id='d7b63e8aa21149e2a0f0fa1cce0f00bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(616db9e7-719c-4ebf-b854-60b79fae7c78),volume_type_id=616db9e7-719c-4ebf-b854-60b79fae7c78)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f2427e-51cd-468c-9ff1-86d9e43f9e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f2427e-51cd-468c-9ff1-86d9e43f9e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f5447e-7471-4b21-b41f-ce05f1e2df4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f5447e-7471-4b21-b41f-ce05f1e2df4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79e968fd-d82e-400a-9dfc-e02a256170c6', 'volume_name': 'volume-79e968fd-d82e-400a-9dfc-e02a256170c6', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf4e195-a461-4744-a466-97ae4e04bcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf4e195-a461-4744-a466-97ae4e04bcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93133d6d-03f7-45dd-9760-c0aafa784b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:07 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Volume 79e968fd-d82e-400a-9dfc-e02a256170c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79e968fd-d82e-400a-9dfc-e02a256170c6', 'volume_size': 1} Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2eca8c10-f700-410d-a578-25ece2425539,created_at=2026-09-01T10:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1753056409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2eca8c10-f700-410d-a578-25ece2425539,host='devstack@QuobyteHD#QuobyteHD',id=79e968fd-d82e-400a-9dfc-e02a256170c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba80b858616e4e44851019dfe96d583b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:10:08Z,use_quota=True,user_id='d7b63e8aa21149e2a0f0fa1cce0f00bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(616db9e7-719c-4ebf-b854-60b79fae7c78),volume_type_id=616db9e7-719c-4ebf-b854-60b79fae7c78)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Creating volume 79e968fd-d82e-400a-9dfc-e02a256170c6 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:10:07 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:10:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:07 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6 1073741824 Sep 01 12:10:07 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:08 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6 1073741824" returned: 0 in 0.589s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:08 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6 Sep 01 12:10:08 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:08 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6" returned: 0 in 0.340s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:10:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93133d6d-03f7-45dd-9760-c0aafa784b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e968fd-d82e-400a-9dfc-e02a256170c6', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe6b099-7973-46f6-b2c5-1bc53c4f93b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:08 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Volume volume-79e968fd-d82e-400a-9dfc-e02a256170c6 (79e968fd-d82e-400a-9dfc-e02a256170c6): created successfully Sep 01 12:10:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe6b099-7973-46f6-b2c5-1bc53c4f93b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Flow 'volume_create_manager' (f168f1af-330c-46e2-8310-7d3c38b9b758) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:10:08 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2aa08e6d-c16b-48af-bf46-4030df9af864 tempest-GroupsV314Test-1405099939 None] Created volume successfully. Sep 01 12:10:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:11 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Cloning volume 79e968fd-d82e-400a-9dfc-e02a256170c6 to volume 1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db Sep 01 12:10:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Creating offline snapshot 209ec4b4-efb4-48c3-9b94-8b1316578b41 of volume 79e968fd-d82e-400a-9dfc-e02a256170c6 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:10:11 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad37e67-ec45-4947-a8a4-85c2371941eb]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:10:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:11 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6 Sep 01 12:10:11 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:11 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6" returned: 0 in 0.441s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:11 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41 1G Sep 01 12:10:11 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:12 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41 1G" returned: 0 in 0.513s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79e968fd-d82e-400a-9dfc-e02a256170c6 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:12 devstack sudo[93903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79e968fd-d82e-400a-9dfc-e02a256170c6 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41 Sep 01 12:10:12 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:12 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79e968fd-d82e-400a-9dfc-e02a256170c6 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41" returned: 0 in 0.478s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:12 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:10:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:12 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41 Sep 01 12:10:12 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:13 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41" returned: 0 in 0.404s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:13 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.info Sep 01 12:10:13 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:13 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.info" returned: 0 in 0.263s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:13 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:10:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:13 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.info Sep 01 12:10:13 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:13 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.info" returned: 0 in 0.359s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Acquiring lock "cinder-quobyte-1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:10:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Lock "cinder-quobyte-1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:10:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] snapshot: 209ec4b4-efb4-48c3-9b94-8b1316578b41, volume: 1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:10:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:10:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:10:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:13 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e0d81f-7e77-4a17-bab6-21839ce987d0]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:10:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:13 devstack sudo[93919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41 Sep 01 12:10:13 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:14 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41" returned: 0 in 0.516s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79e968fd-d82e-400a-9dfc-e02a256170c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:10:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee4929a-c856-4cac-acb5-fdcf8b9e3cfe]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:10:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:14 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6 Sep 01 12:10:14 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:14 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6" returned: 0 in 0.501s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6 {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:10:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:10:14 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Path /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:10:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:14 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db Sep 01 12:10:14 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:17 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-efaa061c-805c-4075-9881-c8386d17cfff tempest-GroupSnapshotsV319Test-427618941 None] Group tempest-GroupSnapshotsV319Test-Group-466614592: creating Sep 01 12:10:17 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-efaa061c-805c-4075-9881-c8386d17cfff tempest-GroupSnapshotsV319Test-427618941 None] Group tempest-GroupSnapshotsV319Test-Group-466614592: created successfully Sep 01 12:10:17 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-efaa061c-805c-4075-9881-c8386d17cfff tempest-GroupSnapshotsV319Test-427618941 None] Create group completed successfully. Sep 01 12:10:18 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:10:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Flow 'volume_create_manager' (e7990142-6ae2-4549-953a-1c8182f70146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:10:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d70da05-57d8-4bd3-a090-e3528ebcfc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d70da05-57d8-4bd3-a090-e3528ebcfc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1477930039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d92fe77-fa30-44e3-b930-c4c3f282adef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d25d77756cd40ffaed40f9b3d54ff32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:10:19Z,use_quota=True,user_id='c064a77f124c43fd9aefa8a9efa0f009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc1eab5a-d489-42a8-839f-0718f70cc737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc1eab5a-d489-42a8-839f-0718f70cc737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cf85dbd-6e27-4a8d-9d5b-833af6afa959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cf85dbd-6e27-4a8d-9d5b-833af6afa959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d92fe77-fa30-44e3-b930-c4c3f282adef', 'volume_name': 'volume-4d92fe77-fa30-44e3-b930-c4c3f282adef', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa4244b-7f9c-4123-82dc-6634b6c5edec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa4244b-7f9c-4123-82dc-6634b6c5edec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96553de0-1b74-4ff3-8fc0-960e1d58b980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:18 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Volume 4d92fe77-fa30-44e3-b930-c4c3f282adef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d92fe77-fa30-44e3-b930-c4c3f282adef', 'volume_size': 1} Sep 01 12:10:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:20 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:10:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Flow 'volume_create_manager' (e3e66dca-8fc6-4abb-9a5b-5e4197a779d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:10:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b75f47d8-aab0-4a60-9030-8815f7c2e777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b75f47d8-aab0-4a60-9030-8815f7c2e777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1953255826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63243864-535e-43cb-b2a7-e65e679835a1,host='devstack@QuobyteHD#QuobyteHD',id=32339c6b-a056-4df5-b081-e874e615f6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='944d3661d2f2486abba9450304ffb9a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:10:21Z,use_quota=True,user_id='4a9adca3ae0e4b3f83efb850ff27ea64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e64841e5-d5c4-4b46-8f35-382ace5cfa64),volume_type_id=e64841e5-d5c4-4b46-8f35-382ace5cfa64)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688ba787-faa3-4614-904d-b9a16f28792c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688ba787-faa3-4614-904d-b9a16f28792c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf35945-40d0-449b-8b8a-06a75b32a527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf35945-40d0-449b-8b8a-06a75b32a527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32339c6b-a056-4df5-b081-e874e615f6a0', 'volume_name': 'volume-32339c6b-a056-4df5-b081-e874e615f6a0', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ce153d-0296-4676-89e3-82558d4340c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ce153d-0296-4676-89e3-82558d4340c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (640d7d23-7151-4150-b81b-642603e1f33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:21 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Volume 32339c6b-a056-4df5-b081-e874e615f6a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32339c6b-a056-4df5-b081-e874e615f6a0', 'volume_size': 1} Sep 01 12:10:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:21 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db" returned: 0 in 6.330s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:21 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:10:21 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Converted 1024.00 MB image at 161.72 MB/s Sep 01 12:10:21 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:10:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:21 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db Sep 01 12:10:21 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:21 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db" returned: 0 in 0.252s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Lock "cinder-quobyte-1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db" released by "_copy_volume_from_snapshot" :: held 7.697s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:10:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Acquiring lock "cinder-quobyte-209ec4b4-efb4-48c3-9b94-8b1316578b41" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:10:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Lock "cinder-quobyte-209ec4b4-efb4-48c3-9b94-8b1316578b41" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:10:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Deleting offline snapshot 209ec4b4-efb4-48c3-9b94-8b1316578b41 of volume 79e968fd-d82e-400a-9dfc-e02a256170c6 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:10:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] snapshot_file for this snap is: volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:10:21 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd18a51-60cd-4f64-a3e5-c8d5765b5950]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:10:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:21 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41 Sep 01 12:10:21 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:21 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41" returned: 0 in 0.475s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79e968fd-d82e-400a-9dfc-e02a256170c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:10:22 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc631a8-fa75-4700-bf1e-51126bb6d713]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:10:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:22 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6 Sep 01 12:10:22 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:22 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6" returned: 0 in 0.548s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:22 devstack sudo[93994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41 Sep 01 12:10:22 devstack sudo[93994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:22 devstack sudo[93994]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41" returned: 0 in 0.340s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:22 devstack sudo[94000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41 Sep 01 12:10:22 devstack sudo[94000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:23 devstack sudo[94000]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6.209ec4b4-efb4-48c3-9b94-8b1316578b41" returned: 0 in 0.261s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Lock "cinder-quobyte-209ec4b4-efb4-48c3-9b94-8b1316578b41" released by "_delete_snapshot" :: held 1.715s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:10:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.085s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.220s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1477930039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d92fe77-fa30-44e3-b930-c4c3f282adef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d25d77756cd40ffaed40f9b3d54ff32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:10:19Z,use_quota=True,user_id='c064a77f124c43fd9aefa8a9efa0f009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:10:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Creating volume 4d92fe77-fa30-44e3-b930-c4c3f282adef {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:10:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:10:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:10:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:10:23 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:10:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4d92fe77-fa30-44e3-b930-c4c3f282adef 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:23 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4d92fe77-fa30-44e3-b930-c4c3f282adef 1073741824 Sep 01 12:10:23 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6d5e2803-559d-40e4-bf5c-da67a5743b49 tempest-GroupsV314Test-1405099939 None] Create group from source-group-2eca8c10-f700-410d-a578-25ece2425539 completed successfully. Sep 01 12:10:23 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4d92fe77-fa30-44e3-b930-c4c3f282adef 1073741824" returned: 0 in 0.562s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4d92fe77-fa30-44e3-b930-c4c3f282adef {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:23 devstack sudo[94009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4d92fe77-fa30-44e3-b930-c4c3f282adef Sep 01 12:10:23 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a17bbf9b-14f6-4a91-9dde-0e3fa7d4151d tempest-GroupsV314Test-1405099939 None] Acquiring lock "cinder-quobyte-1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a17bbf9b-14f6-4a91-9dde-0e3fa7d4151d tempest-GroupsV314Test-1405099939 None] Lock "cinder-quobyte-1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c94a49-2b3a-416a-be98-7bd08d46d079]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a17bbf9b-14f6-4a91-9dde-0e3fa7d4151d tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:24 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4d92fe77-fa30-44e3-b930-c4c3f282adef" returned: 0 in 0.298s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.084s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=63243864-535e-43cb-b2a7-e65e679835a1,created_at=2026-09-01T10:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1953255826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63243864-535e-43cb-b2a7-e65e679835a1,host='devstack@QuobyteHD#QuobyteHD',id=32339c6b-a056-4df5-b081-e874e615f6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='944d3661d2f2486abba9450304ffb9a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:10:21Z,use_quota=True,user_id='4a9adca3ae0e4b3f83efb850ff27ea64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e64841e5-d5c4-4b46-8f35-382ace5cfa64),volume_type_id=e64841e5-d5c4-4b46-8f35-382ace5cfa64)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Creating volume 32339c6b-a056-4df5-b081-e874e615f6a0 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:10:24 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96553de0-1b74-4ff3-8fc0-960e1d58b980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d92fe77-fa30-44e3-b930-c4c3f282adef', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2593d37d-2623-4d32-816f-b5404a316630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:24 devstack sudo[94014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0 1073741824 Sep 01 12:10:24 devstack sudo[94014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:24 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db Sep 01 12:10:24 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:24 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Volume volume-4d92fe77-fa30-44e3-b930-c4c3f282adef (4d92fe77-fa30-44e3-b930-c4c3f282adef): created successfully Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2593d37d-2623-4d32-816f-b5404a316630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Flow 'volume_create_manager' (e7990142-6ae2-4549-953a-1c8182f70146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:10:24 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7a47d76f-0417-40b2-9fff-f0bef28cdfde tempest-VolumesMetadataTest-50417662 None] Created volume successfully. Sep 01 12:10:24 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a17bbf9b-14f6-4a91-9dde-0e3fa7d4151d tempest-GroupsV314Test-1405099939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db" returned: 0 in 0.565s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a17bbf9b-14f6-4a91-9dde-0e3fa7d4151d tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:24 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db Sep 01 12:10:24 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:24 devstack sudo[94014]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0 1073741824" returned: 0 in 0.735s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:24 devstack sudo[94026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0 Sep 01 12:10:24 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:25 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a17bbf9b-14f6-4a91-9dde-0e3fa7d4151d tempest-GroupsV314Test-1405099939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db" returned: 0 in 0.403s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a17bbf9b-14f6-4a91-9dde-0e3fa7d4151d tempest-GroupsV314Test-1405099939 None] Lock "cinder-quobyte-1b9f126e-fe26-4a6f-a5f5-7c6f9598e6db" released by "delete_volume" :: held 1.035s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a17bbf9b-14f6-4a91-9dde-0e3fa7d4151d tempest-GroupsV314Test-1405099939 None] Created reservations ['40f0f5bf-7ffa-490f-86b6-2cf3041cdeaa'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:10:25 devstack cinder-volume[87084]: WARNING cinder.quota [None req-a17bbf9b-14f6-4a91-9dde-0e3fa7d4151d tempest-GroupsV314Test-1405099939 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1729943511 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1729943511, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:10:25 devstack cinder-volume[87084]: WARNING cinder.quota [None req-a17bbf9b-14f6-4a91-9dde-0e3fa7d4151d tempest-GroupsV314Test-1405099939 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1729943511 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1729943511, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a17bbf9b-14f6-4a91-9dde-0e3fa7d4151d tempest-GroupsV314Test-1405099939 None] Created reservations ['4d6dcceb-e7f9-40b8-b084-efc3140f634b', '38dd5ec7-adc8-416e-9511-6006c6e31419', 'd9115241-60e5-4758-a967-21e368ba5105', '127b9b41-380c-47f2-9179-c4f2daa93c1d'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:10:25 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0" returned: 0 in 0.346s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (640d7d23-7151-4150-b81b-642603e1f33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32339c6b-a056-4df5-b081-e874e615f6a0', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72f81a31-30d3-40c9-8b2f-c2b301588f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:25 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Volume volume-32339c6b-a056-4df5-b081-e874e615f6a0 (32339c6b-a056-4df5-b081-e874e615f6a0): created successfully Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72f81a31-30d3-40c9-8b2f-c2b301588f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Flow 'volume_create_manager' (e3e66dca-8fc6-4abb-9a5b-5e4197a779d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:10:25 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3cf3e9c6-7c48-4166-aff4-e126fd9ee45a tempest-GroupSnapshotsV319Test-427618941 None] Created volume successfully. Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a17bbf9b-14f6-4a91-9dde-0e3fa7d4151d tempest-GroupsV314Test-1405099939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a17bbf9b-14f6-4a91-9dde-0e3fa7d4151d tempest-GroupsV314Test-1405099939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a17bbf9b-14f6-4a91-9dde-0e3fa7d4151d tempest-GroupsV314Test-1405099939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a17bbf9b-14f6-4a91-9dde-0e3fa7d4151d tempest-GroupsV314Test-1405099939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a17bbf9b-14f6-4a91-9dde-0e3fa7d4151d tempest-GroupsV314Test-1405099939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a17bbf9b-14f6-4a91-9dde-0e3fa7d4151d tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:25 devstack sudo[94030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:10:25 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d1f1ee9-46ad-4102-945c-64aa46a83278 tempest-VolumesMetadataTest-50417662 None] Acquiring lock "cinder-4d92fe77-fa30-44e3-b930-c4c3f282adef-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d1f1ee9-46ad-4102-945c-64aa46a83278 tempest-VolumesMetadataTest-50417662 None] Lock "cinder-4d92fe77-fa30-44e3-b930-c4c3f282adef-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d1f1ee9-46ad-4102-945c-64aa46a83278 tempest-VolumesMetadataTest-50417662 None] Acquiring lock "cinder-quobyte-4d92fe77-fa30-44e3-b930-c4c3f282adef" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d1f1ee9-46ad-4102-945c-64aa46a83278 tempest-VolumesMetadataTest-50417662 None] Lock "cinder-quobyte-4d92fe77-fa30-44e3-b930-c4c3f282adef" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2047d051-932a-4e74-97e8-424c1c52bcb4]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d1f1ee9-46ad-4102-945c-64aa46a83278 tempest-VolumesMetadataTest-50417662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4d92fe77-fa30-44e3-b930-c4c3f282adef {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:25 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a17bbf9b-14f6-4a91-9dde-0e3fa7d4151d tempest-GroupsV314Test-1405099939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.331s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:25 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-a17bbf9b-14f6-4a91-9dde-0e3fa7d4151d tempest-GroupsV314Test-1405099939 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:10:25 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a17bbf9b-14f6-4a91-9dde-0e3fa7d4151d tempest-GroupsV314Test-1405099939 None] Delete group completed successfully. Sep 01 12:10:25 devstack sudo[94032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4d92fe77-fa30-44e3-b930-c4c3f282adef Sep 01 12:10:25 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:26 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d1f1ee9-46ad-4102-945c-64aa46a83278 tempest-VolumesMetadataTest-50417662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4d92fe77-fa30-44e3-b930-c4c3f282adef" returned: 0 in 0.448s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d1f1ee9-46ad-4102-945c-64aa46a83278 tempest-VolumesMetadataTest-50417662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4d92fe77-fa30-44e3-b930-c4c3f282adef {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:26 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d38fa120-8a46-4f8f-8b56-8a449838faf1 tempest-GroupSnapshotsV319Test-427618941 None] GroupSnapshot 9b72a7d4-50d3-4689-a503-eeae93d6855e: creating. Sep 01 12:10:26 devstack sudo[94038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4d92fe77-fa30-44e3-b930-c4c3f282adef Sep 01 12:10:26 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d38fa120-8a46-4f8f-8b56-8a449838faf1 tempest-GroupSnapshotsV319Test-427618941 None] Group snapshot 9b72a7d4-50d3-4689-a503-eeae93d6855e: creating. {{(pid=87084) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 12:10:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d38fa120-8a46-4f8f-8b56-8a449838faf1 tempest-GroupSnapshotsV319Test-427618941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d38fa120-8a46-4f8f-8b56-8a449838faf1 tempest-GroupSnapshotsV319Test-427618941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-d38fa120-8a46-4f8f-8b56-8a449838faf1 tempest-GroupSnapshotsV319Test-427618941 None] Creating offline snapshot cf115d2e-308a-4003-9f4f-b0d506cbdb60 of volume 32339c6b-a056-4df5-b081-e874e615f6a0 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:10:26 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c35cd22-76af-4ff4-8596-6a483a811aff]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:10:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d38fa120-8a46-4f8f-8b56-8a449838faf1 tempest-GroupSnapshotsV319Test-427618941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:26 devstack sudo[94040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0 Sep 01 12:10:26 devstack sudo[94040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:26 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d1f1ee9-46ad-4102-945c-64aa46a83278 tempest-VolumesMetadataTest-50417662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4d92fe77-fa30-44e3-b930-c4c3f282adef" returned: 0 in 0.277s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d1f1ee9-46ad-4102-945c-64aa46a83278 tempest-VolumesMetadataTest-50417662 None] Lock "cinder-quobyte-4d92fe77-fa30-44e3-b930-c4c3f282adef" released by "delete_volume" :: held 0.766s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:10:26 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-6d1f1ee9-46ad-4102-945c-64aa46a83278 tempest-VolumesMetadataTest-50417662 None] Created reservations ['151b2246-9993-4923-a55e-9b157218a885', '2519fdd0-feb1-488c-9372-24d39bfe5ea5', 'add478ec-2f87-44e0-be8d-719259423701', 'a951a28b-3df7-4d5b-9287-ec38d59ab21c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:10:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6d1f1ee9-46ad-4102-945c-64aa46a83278 tempest-VolumesMetadataTest-50417662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6d1f1ee9-46ad-4102-945c-64aa46a83278 tempest-VolumesMetadataTest-50417662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6d1f1ee9-46ad-4102-945c-64aa46a83278 tempest-VolumesMetadataTest-50417662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:10:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6d1f1ee9-46ad-4102-945c-64aa46a83278 tempest-VolumesMetadataTest-50417662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:10:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6d1f1ee9-46ad-4102-945c-64aa46a83278 tempest-VolumesMetadataTest-50417662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d1f1ee9-46ad-4102-945c-64aa46a83278 tempest-VolumesMetadataTest-50417662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:26 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:10:26 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:26 devstack sudo[94040]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d38fa120-8a46-4f8f-8b56-8a449838faf1 tempest-GroupSnapshotsV319Test-427618941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0" returned: 0 in 0.434s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d38fa120-8a46-4f8f-8b56-8a449838faf1 tempest-GroupSnapshotsV319Test-427618941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.cf115d2e-308a-4003-9f4f-b0d506cbdb60 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:26 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.cf115d2e-308a-4003-9f4f-b0d506cbdb60 1G Sep 01 12:10:26 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a7b8eb3b-e914-4b0b-9f07-bf2c9de001e0 tempest-GroupsV314Test-1405099939 None] Acquiring lock "cinder-quobyte-79e968fd-d82e-400a-9dfc-e02a256170c6" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:10:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a7b8eb3b-e914-4b0b-9f07-bf2c9de001e0 tempest-GroupsV314Test-1405099939 None] Lock "cinder-quobyte-79e968fd-d82e-400a-9dfc-e02a256170c6" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:10:27 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73f8ac8-4836-444e-80dd-3c9bced5d4e3]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:10:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a7b8eb3b-e914-4b0b-9f07-bf2c9de001e0 tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:27 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6d1f1ee9-46ad-4102-945c-64aa46a83278 tempest-VolumesMetadataTest-50417662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.682s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:27 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-6d1f1ee9-46ad-4102-945c-64aa46a83278 tempest-VolumesMetadataTest-50417662 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:10:27 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6d1f1ee9-46ad-4102-945c-64aa46a83278 tempest-VolumesMetadataTest-50417662 None] Deleted volume successfully. Sep 01 12:10:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6d1f1ee9-46ad-4102-945c-64aa46a83278 tempest-VolumesMetadataTest-50417662 None] Lock "cinder-4d92fe77-fa30-44e3-b930-c4c3f282adef-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:10:27 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6 Sep 01 12:10:27 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:27 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d38fa120-8a46-4f8f-8b56-8a449838faf1 tempest-GroupSnapshotsV319Test-427618941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.cf115d2e-308a-4003-9f4f-b0d506cbdb60 1G" returned: 0 in 0.726s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d38fa120-8a46-4f8f-8b56-8a449838faf1 tempest-GroupSnapshotsV319Test-427618941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32339c6b-a056-4df5-b081-e874e615f6a0 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.cf115d2e-308a-4003-9f4f-b0d506cbdb60 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:27 devstack sudo[94057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32339c6b-a056-4df5-b081-e874e615f6a0 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.cf115d2e-308a-4003-9f4f-b0d506cbdb60 Sep 01 12:10:27 devstack sudo[94057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:27 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a7b8eb3b-e914-4b0b-9f07-bf2c9de001e0 tempest-GroupsV314Test-1405099939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6" returned: 0 in 0.753s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a7b8eb3b-e914-4b0b-9f07-bf2c9de001e0 tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:27 devstack sudo[94072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6 Sep 01 12:10:27 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:27 devstack sudo[94057]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d38fa120-8a46-4f8f-8b56-8a449838faf1 tempest-GroupSnapshotsV319Test-427618941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32339c6b-a056-4df5-b081-e874e615f6a0 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.cf115d2e-308a-4003-9f4f-b0d506cbdb60" returned: 0 in 0.515s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:27 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-d38fa120-8a46-4f8f-8b56-8a449838faf1 tempest-GroupSnapshotsV319Test-427618941 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.cf115d2e-308a-4003-9f4f-b0d506cbdb60 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:10:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d38fa120-8a46-4f8f-8b56-8a449838faf1 tempest-GroupSnapshotsV319Test-427618941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.cf115d2e-308a-4003-9f4f-b0d506cbdb60 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:27 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.cf115d2e-308a-4003-9f4f-b0d506cbdb60 Sep 01 12:10:27 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:28 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a7b8eb3b-e914-4b0b-9f07-bf2c9de001e0 tempest-GroupsV314Test-1405099939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79e968fd-d82e-400a-9dfc-e02a256170c6" returned: 0 in 0.358s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a7b8eb3b-e914-4b0b-9f07-bf2c9de001e0 tempest-GroupsV314Test-1405099939 None] Lock "cinder-quobyte-79e968fd-d82e-400a-9dfc-e02a256170c6" released by "delete_volume" :: held 1.240s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:10:28 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d38fa120-8a46-4f8f-8b56-8a449838faf1 tempest-GroupSnapshotsV319Test-427618941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.cf115d2e-308a-4003-9f4f-b0d506cbdb60" returned: 0 in 0.356s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d38fa120-8a46-4f8f-8b56-8a449838faf1 tempest-GroupSnapshotsV319Test-427618941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:28 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a7b8eb3b-e914-4b0b-9f07-bf2c9de001e0 tempest-GroupsV314Test-1405099939 None] Created reservations ['bb6f363a-3e9d-484f-a3f3-3f1dde74777d'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:10:28 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.info Sep 01 12:10:28 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:28 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a7b8eb3b-e914-4b0b-9f07-bf2c9de001e0 tempest-GroupsV314Test-1405099939 None] Created reservations ['632dd97f-72f9-4e75-9ac4-71adaadcbd57', '1d1b2dee-c1bd-4e2a-b99a-535f76073543', 'b6100217-a85a-455d-97e6-28031a6daa5a', 'e05be52a-1892-4e66-a4da-9be36b6a1bbf'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:10:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a7b8eb3b-e914-4b0b-9f07-bf2c9de001e0 tempest-GroupsV314Test-1405099939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a7b8eb3b-e914-4b0b-9f07-bf2c9de001e0 tempest-GroupsV314Test-1405099939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a7b8eb3b-e914-4b0b-9f07-bf2c9de001e0 tempest-GroupsV314Test-1405099939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:10:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a7b8eb3b-e914-4b0b-9f07-bf2c9de001e0 tempest-GroupsV314Test-1405099939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:10:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a7b8eb3b-e914-4b0b-9f07-bf2c9de001e0 tempest-GroupsV314Test-1405099939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a7b8eb3b-e914-4b0b-9f07-bf2c9de001e0 tempest-GroupsV314Test-1405099939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:28 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:10:28 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:28 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d38fa120-8a46-4f8f-8b56-8a449838faf1 tempest-GroupSnapshotsV319Test-427618941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.info" returned: 0 in 0.464s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:28 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-d38fa120-8a46-4f8f-8b56-8a449838faf1 tempest-GroupSnapshotsV319Test-427618941 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:10:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d38fa120-8a46-4f8f-8b56-8a449838faf1 tempest-GroupSnapshotsV319Test-427618941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:28 devstack sudo[94083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.info Sep 01 12:10:28 devstack sudo[94083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:28 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a7b8eb3b-e914-4b0b-9f07-bf2c9de001e0 tempest-GroupsV314Test-1405099939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.322s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:28 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-a7b8eb3b-e914-4b0b-9f07-bf2c9de001e0 tempest-GroupsV314Test-1405099939 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:10:28 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a7b8eb3b-e914-4b0b-9f07-bf2c9de001e0 tempest-GroupsV314Test-1405099939 None] Delete group completed successfully. Sep 01 12:10:29 devstack sudo[94083]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d38fa120-8a46-4f8f-8b56-8a449838faf1 tempest-GroupSnapshotsV319Test-427618941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.info" returned: 0 in 0.274s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d38fa120-8a46-4f8f-8b56-8a449838faf1 tempest-GroupSnapshotsV319Test-427618941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.869s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d38fa120-8a46-4f8f-8b56-8a449838faf1 tempest-GroupSnapshotsV319Test-427618941 None] group_snapshot 9b72a7d4-50d3-4689-a503-eeae93d6855e: created successfully Sep 01 12:10:30 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] group_snapshot 9b72a7d4-50d3-4689-a503-eeae93d6855e: deleting Sep 01 12:10:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] group_snapshot 9b72a7d4-50d3-4689-a503-eeae93d6855e: deleting {{(pid=87084) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 12:10:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] Acquiring lock "cinder-quobyte-32339c6b-a056-4df5-b081-e874e615f6a0" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:10:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] Lock "cinder-quobyte-32339c6b-a056-4df5-b081-e874e615f6a0" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:10:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] Acquiring lock "cinder-quobyte-cf115d2e-308a-4003-9f4f-b0d506cbdb60" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:10:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] Lock "cinder-quobyte-cf115d2e-308a-4003-9f4f-b0d506cbdb60" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:10:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] Deleting offline snapshot cf115d2e-308a-4003-9f4f-b0d506cbdb60 of volume 32339c6b-a056-4df5-b081-e874e615f6a0 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:10:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] snapshot_file for this snap is: volume-32339c6b-a056-4df5-b081-e874e615f6a0.cf115d2e-308a-4003-9f4f-b0d506cbdb60 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:10:30 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49fe882-057e-4382-9e70-4f24d7780e80]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:10:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.cf115d2e-308a-4003-9f4f-b0d506cbdb60 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:30 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.cf115d2e-308a-4003-9f4f-b0d506cbdb60 Sep 01 12:10:30 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:30 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.cf115d2e-308a-4003-9f4f-b0d506cbdb60" returned: 0 in 0.497s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32339c6b-a056-4df5-b081-e874e615f6a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:10:30 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7addc2eb-27ca-40a6-8992-d881697fd42b]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:10:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:30 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0 Sep 01 12:10:30 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:31 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0" returned: 0 in 0.442s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.cf115d2e-308a-4003-9f4f-b0d506cbdb60 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:31 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.cf115d2e-308a-4003-9f4f-b0d506cbdb60 Sep 01 12:10:31 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:31 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.cf115d2e-308a-4003-9f4f-b0d506cbdb60" returned: 0 in 0.456s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.cf115d2e-308a-4003-9f4f-b0d506cbdb60 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:31 devstack sudo[94102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.cf115d2e-308a-4003-9f4f-b0d506cbdb60 Sep 01 12:10:31 devstack sudo[94102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:31 devstack sudo[94102]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0.cf115d2e-308a-4003-9f4f-b0d506cbdb60" returned: 0 in 0.295s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] Lock "cinder-quobyte-cf115d2e-308a-4003-9f4f-b0d506cbdb60" released by "_delete_snapshot" :: held 1.853s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:10:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] Lock "cinder-quobyte-32339c6b-a056-4df5-b081-e874e615f6a0" released by "delete_snapshot" :: held 1.891s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:10:32 devstack cinder-volume[87084]: WARNING cinder.quota [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1009998183 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1009998183, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:10:32 devstack cinder-volume[87084]: WARNING cinder.quota [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1009998183 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1009998183, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:10:32 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] Created reservations ['34aca484-f9c1-48a3-8003-d66a9da909cb', '03dcf65f-5038-44d3-bb52-c98ef6529e0b', '82f3bba3-c331-4996-86d8-68f8f26a5f4b', 'b41c976b-9b0c-46ab-b49f-f9f7e511f79c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:10:32 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-30c16224-241c-471e-87cf-4847fa909563 tempest-GroupSnapshotsV319Test-427618941 None] group_snapshot 9b72a7d4-50d3-4689-a503-eeae93d6855e: deleted successfully Sep 01 12:10:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-deb1fb0f-509b-4989-805a-a4ed6f8c660b tempest-GroupSnapshotsV319Test-427618941 None] Acquiring lock "cinder-quobyte-32339c6b-a056-4df5-b081-e874e615f6a0" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:10:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-deb1fb0f-509b-4989-805a-a4ed6f8c660b tempest-GroupSnapshotsV319Test-427618941 None] Lock "cinder-quobyte-32339c6b-a056-4df5-b081-e874e615f6a0" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:10:32 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5472c02-859d-4022-9f4e-57bb9d4ed96a]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:10:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-deb1fb0f-509b-4989-805a-a4ed6f8c660b tempest-GroupSnapshotsV319Test-427618941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:33 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0 Sep 01 12:10:33 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:33 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-deb1fb0f-509b-4989-805a-a4ed6f8c660b tempest-GroupSnapshotsV319Test-427618941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0" returned: 0 in 0.553s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-deb1fb0f-509b-4989-805a-a4ed6f8c660b tempest-GroupSnapshotsV319Test-427618941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:33 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0 Sep 01 12:10:33 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:33 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-deb1fb0f-509b-4989-805a-a4ed6f8c660b tempest-GroupSnapshotsV319Test-427618941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-32339c6b-a056-4df5-b081-e874e615f6a0" returned: 0 in 0.296s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:33 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-deb1fb0f-509b-4989-805a-a4ed6f8c660b tempest-GroupSnapshotsV319Test-427618941 None] Lock "cinder-quobyte-32339c6b-a056-4df5-b081-e874e615f6a0" released by "delete_volume" :: held 0.954s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:10:33 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-deb1fb0f-509b-4989-805a-a4ed6f8c660b tempest-GroupSnapshotsV319Test-427618941 None] Created reservations ['bc8f6092-7100-436d-b84a-66cf3be5232b'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:10:34 devstack cinder-volume[87084]: WARNING cinder.quota [None req-deb1fb0f-509b-4989-805a-a4ed6f8c660b tempest-GroupSnapshotsV319Test-427618941 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1009998183 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1009998183, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-deb1fb0f-509b-4989-805a-a4ed6f8c660b tempest-GroupSnapshotsV319Test-427618941 None] Created reservations ['363b1615-7c7c-4655-888b-1f74abc4ff3d', '700cb6b2-dd87-4c7a-9e1a-f9aab2aec4c4', 'b6939ac1-dfa6-4d03-9178-c80f6c694463', 'b0f8999d-7cbb-4764-ac58-33c20669b483'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-deb1fb0f-509b-4989-805a-a4ed6f8c660b tempest-GroupSnapshotsV319Test-427618941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-deb1fb0f-509b-4989-805a-a4ed6f8c660b tempest-GroupSnapshotsV319Test-427618941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-deb1fb0f-509b-4989-805a-a4ed6f8c660b tempest-GroupSnapshotsV319Test-427618941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-deb1fb0f-509b-4989-805a-a4ed6f8c660b tempest-GroupSnapshotsV319Test-427618941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-deb1fb0f-509b-4989-805a-a4ed6f8c660b tempest-GroupSnapshotsV319Test-427618941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-deb1fb0f-509b-4989-805a-a4ed6f8c660b tempest-GroupSnapshotsV319Test-427618941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:34 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:10:34 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Flow 'volume_create_manager' (d523cc0c-7370-476a-9da7-e735a209817a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da54648-68e8-4fb3-8072-f7da42fabd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da54648-68e8-4fb3-8072-f7da42fabd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-296246629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cabd9eb-875e-403e-93da-38e57dd931e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9e8ae934804891a3bacf4e532296f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:10:34Z,use_quota=True,user_id='fe62055bf2f0488e8e72df2ce9800e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f73e1064-0825-4f6f-ad2d-4c230be47381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f73e1064-0825-4f6f-ad2d-4c230be47381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e77940-b417-4003-aaa3-750f6aa5b07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e77940-b417-4003-aaa3-750f6aa5b07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cabd9eb-875e-403e-93da-38e57dd931e9', 'volume_name': 'volume-9cabd9eb-875e-403e-93da-38e57dd931e9', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5d5b72-9440-4a96-9560-e02532b59b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5d5b72-9440-4a96-9560-e02532b59b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1197252-5eb6-4ac5-afc5-b87f8bfef82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:34 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Volume 9cabd9eb-875e-403e-93da-38e57dd931e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cabd9eb-875e-403e-93da-38e57dd931e9', 'volume_size': 1} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-296246629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cabd9eb-875e-403e-93da-38e57dd931e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9e8ae934804891a3bacf4e532296f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:10:34Z,use_quota=True,user_id='fe62055bf2f0488e8e72df2ce9800e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Creating volume 9cabd9eb-875e-403e-93da-38e57dd931e9 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:10:34 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cabd9eb-875e-403e-93da-38e57dd931e9 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:34 devstack sudo[94119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cabd9eb-875e-403e-93da-38e57dd931e9 1073741824 Sep 01 12:10:34 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:34 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-deb1fb0f-509b-4989-805a-a4ed6f8c660b tempest-GroupSnapshotsV319Test-427618941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.387s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:34 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-deb1fb0f-509b-4989-805a-a4ed6f8c660b tempest-GroupSnapshotsV319Test-427618941 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:10:34 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-deb1fb0f-509b-4989-805a-a4ed6f8c660b tempest-GroupSnapshotsV319Test-427618941 None] Delete group completed successfully. Sep 01 12:10:35 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cabd9eb-875e-403e-93da-38e57dd931e9 1073741824" returned: 0 in 0.591s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cabd9eb-875e-403e-93da-38e57dd931e9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:35 devstack sudo[94127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cabd9eb-875e-403e-93da-38e57dd931e9 Sep 01 12:10:35 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:35 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cabd9eb-875e-403e-93da-38e57dd931e9" returned: 0 in 0.371s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:10:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1197252-5eb6-4ac5-afc5-b87f8bfef82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cabd9eb-875e-403e-93da-38e57dd931e9', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f399f85-4735-468b-898b-c8d46a498f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:35 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Volume volume-9cabd9eb-875e-403e-93da-38e57dd931e9 (9cabd9eb-875e-403e-93da-38e57dd931e9): created successfully Sep 01 12:10:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f399f85-4735-468b-898b-c8d46a498f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Flow 'volume_create_manager' (d523cc0c-7370-476a-9da7-e735a209817a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:10:35 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-824d478e-dc36-4916-a27d-05c6351e492d tempest-VolumesTransfersTest-1236370875 None] Created volume successfully. Sep 01 12:10:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a680d457-2e07-4b70-a37a-d33fad7e3d5f tempest-VolumesTransfersTest-1694159200 None] Transfer volume completed successfully. Sep 01 12:10:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b75f7bfe-84d5-420c-9096-df4245714338 tempest-GroupsV320Test-1315655723 None] Group tempest-GroupsV320Test-Group-2083986989: creating Sep 01 12:10:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b75f7bfe-84d5-420c-9096-df4245714338 tempest-GroupsV320Test-1315655723 None] Group tempest-GroupsV320Test-Group-2083986989: created successfully Sep 01 12:10:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b75f7bfe-84d5-420c-9096-df4245714338 tempest-GroupsV320Test-1315655723 None] Create group completed successfully. Sep 01 12:10:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85e0bf60-2a20-41c2-8ac2-90eac549961d tempest-VolumesTransfersTest-1253152248 None] Acquiring lock "cinder-9cabd9eb-875e-403e-93da-38e57dd931e9-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:10:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85e0bf60-2a20-41c2-8ac2-90eac549961d tempest-VolumesTransfersTest-1253152248 None] Lock "cinder-9cabd9eb-875e-403e-93da-38e57dd931e9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:10:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85e0bf60-2a20-41c2-8ac2-90eac549961d tempest-VolumesTransfersTest-1253152248 None] Acquiring lock "cinder-quobyte-9cabd9eb-875e-403e-93da-38e57dd931e9" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:10:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85e0bf60-2a20-41c2-8ac2-90eac549961d tempest-VolumesTransfersTest-1253152248 None] Lock "cinder-quobyte-9cabd9eb-875e-403e-93da-38e57dd931e9" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:10:38 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c77fff-33cf-4eaa-9523-c67155ac1125]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:10:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85e0bf60-2a20-41c2-8ac2-90eac549961d tempest-VolumesTransfersTest-1253152248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cabd9eb-875e-403e-93da-38e57dd931e9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:38 devstack sudo[94147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cabd9eb-875e-403e-93da-38e57dd931e9 Sep 01 12:10:38 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:38 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85e0bf60-2a20-41c2-8ac2-90eac549961d tempest-VolumesTransfersTest-1253152248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cabd9eb-875e-403e-93da-38e57dd931e9" returned: 0 in 0.455s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85e0bf60-2a20-41c2-8ac2-90eac549961d tempest-VolumesTransfersTest-1253152248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cabd9eb-875e-403e-93da-38e57dd931e9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:38 devstack sudo[94153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cabd9eb-875e-403e-93da-38e57dd931e9 Sep 01 12:10:38 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:39 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85e0bf60-2a20-41c2-8ac2-90eac549961d tempest-VolumesTransfersTest-1253152248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cabd9eb-875e-403e-93da-38e57dd931e9" returned: 0 in 0.367s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85e0bf60-2a20-41c2-8ac2-90eac549961d tempest-VolumesTransfersTest-1253152248 None] Lock "cinder-quobyte-9cabd9eb-875e-403e-93da-38e57dd931e9" released by "delete_volume" :: held 0.888s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:10:39 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-85e0bf60-2a20-41c2-8ac2-90eac549961d tempest-VolumesTransfersTest-1253152248 None] Created reservations ['118b079d-33ec-4f96-ba46-df4e055b8331', '5f6ea4f9-af40-432a-bca2-c4d4282b10ca', '769cdac4-7eeb-4ac0-a03b-b1655099ce02', '96c461f2-97be-4247-b0b0-f87f05dfec44'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:10:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-85e0bf60-2a20-41c2-8ac2-90eac549961d tempest-VolumesTransfersTest-1253152248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-85e0bf60-2a20-41c2-8ac2-90eac549961d tempest-VolumesTransfersTest-1253152248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-85e0bf60-2a20-41c2-8ac2-90eac549961d tempest-VolumesTransfersTest-1253152248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:10:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-85e0bf60-2a20-41c2-8ac2-90eac549961d tempest-VolumesTransfersTest-1253152248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:10:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-85e0bf60-2a20-41c2-8ac2-90eac549961d tempest-VolumesTransfersTest-1253152248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85e0bf60-2a20-41c2-8ac2-90eac549961d tempest-VolumesTransfersTest-1253152248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:39 devstack sudo[94156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:10:39 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:39 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-0c1ddb3a-caff-4205-b2c7-d24824ffa74d tempest-GroupsV320Test-1315655723 None] Created reservations ['833030ba-d37d-4036-82ec-e64ae13be45c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:10:39 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85e0bf60-2a20-41c2-8ac2-90eac549961d tempest-VolumesTransfersTest-1253152248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.474s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:39 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-85e0bf60-2a20-41c2-8ac2-90eac549961d tempest-VolumesTransfersTest-1253152248 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:10:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0c1ddb3a-caff-4205-b2c7-d24824ffa74d tempest-GroupsV320Test-1315655723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0c1ddb3a-caff-4205-b2c7-d24824ffa74d tempest-GroupsV320Test-1315655723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0c1ddb3a-caff-4205-b2c7-d24824ffa74d tempest-GroupsV320Test-1315655723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:10:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0c1ddb3a-caff-4205-b2c7-d24824ffa74d tempest-GroupsV320Test-1315655723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:10:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0c1ddb3a-caff-4205-b2c7-d24824ffa74d tempest-GroupsV320Test-1315655723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c1ddb3a-caff-4205-b2c7-d24824ffa74d tempest-GroupsV320Test-1315655723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:39 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-85e0bf60-2a20-41c2-8ac2-90eac549961d tempest-VolumesTransfersTest-1253152248 None] Deleted volume successfully. Sep 01 12:10:39 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:10:39 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85e0bf60-2a20-41c2-8ac2-90eac549961d tempest-VolumesTransfersTest-1253152248 None] Lock "cinder-9cabd9eb-875e-403e-93da-38e57dd931e9-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:10:40 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c1ddb3a-caff-4205-b2c7-d24824ffa74d tempest-GroupsV320Test-1315655723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.488s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:40 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-0c1ddb3a-caff-4205-b2c7-d24824ffa74d tempest-GroupsV320Test-1315655723 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:10:40 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0c1ddb3a-caff-4205-b2c7-d24824ffa74d tempest-GroupsV320Test-1315655723 None] Delete group completed successfully. Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Flow 'volume_create_manager' (b4dcc74c-20c5-47d8-a28a-19bd1b426434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceba634f-5985-4db0-8928-7e84f7b443a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceba634f-5985-4db0-8928-7e84f7b443a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-215758762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085dd630-1f4d-45e9-ba34-cbc515f11864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9e8ae934804891a3bacf4e532296f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:10:41Z,use_quota=True,user_id='fe62055bf2f0488e8e72df2ce9800e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0f1398-6de7-4818-8083-dbc98c34318a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0f1398-6de7-4818-8083-dbc98c34318a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c2386f-7b5a-4b6d-be1a-64d10c56c6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c2386f-7b5a-4b6d-be1a-64d10c56c6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '085dd630-1f4d-45e9-ba34-cbc515f11864', 'volume_name': 'volume-085dd630-1f4d-45e9-ba34-cbc515f11864', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a95162-1718-4e6f-918b-accd6d6aee36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a95162-1718-4e6f-918b-accd6d6aee36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78838996-ec9f-4be6-84cb-ebf92f804373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Volume 085dd630-1f4d-45e9-ba34-cbc515f11864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-085dd630-1f4d-45e9-ba34-cbc515f11864', 'volume_size': 1} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-215758762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085dd630-1f4d-45e9-ba34-cbc515f11864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9e8ae934804891a3bacf4e532296f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:10:41Z,use_quota=True,user_id='fe62055bf2f0488e8e72df2ce9800e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Creating volume 085dd630-1f4d-45e9-ba34-cbc515f11864 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:10:41 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-085dd630-1f4d-45e9-ba34-cbc515f11864 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:41 devstack sudo[94232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-085dd630-1f4d-45e9-ba34-cbc515f11864 1073741824 Sep 01 12:10:41 devstack sudo[94232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:41 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:10:41 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:42 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.667s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:10:42 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:10:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:10:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:10:42 devstack sudo[94232]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-085dd630-1f4d-45e9-ba34-cbc515f11864 1073741824" returned: 0 in 0.895s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-085dd630-1f4d-45e9-ba34-cbc515f11864 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:42 devstack sudo[94242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-085dd630-1f4d-45e9-ba34-cbc515f11864 Sep 01 12:10:42 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:42 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-085dd630-1f4d-45e9-ba34-cbc515f11864" returned: 0 in 0.393s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:10:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78838996-ec9f-4be6-84cb-ebf92f804373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-085dd630-1f4d-45e9-ba34-cbc515f11864', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (326370c5-da30-4509-9bd2-2363bac1bd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:43 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Volume volume-085dd630-1f4d-45e9-ba34-cbc515f11864 (085dd630-1f4d-45e9-ba34-cbc515f11864): created successfully Sep 01 12:10:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (326370c5-da30-4509-9bd2-2363bac1bd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Flow 'volume_create_manager' (b4dcc74c-20c5-47d8-a28a-19bd1b426434) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:10:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-425bceb4-3ecc-4a1a-bb1c-b7d2a7b3f41c tempest-VolumesTransfersTest-1236370875 None] Created volume successfully. Sep 01 12:10:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9ade324c-526e-4212-815c-bc2cbb47fee0 tempest-VolumesTransfersTest-1253152248 None] Acquiring lock "cinder-085dd630-1f4d-45e9-ba34-cbc515f11864-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:10:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9ade324c-526e-4212-815c-bc2cbb47fee0 tempest-VolumesTransfersTest-1253152248 None] Lock "cinder-085dd630-1f4d-45e9-ba34-cbc515f11864-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:10:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9ade324c-526e-4212-815c-bc2cbb47fee0 tempest-VolumesTransfersTest-1253152248 None] Acquiring lock "cinder-quobyte-085dd630-1f4d-45e9-ba34-cbc515f11864" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:10:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9ade324c-526e-4212-815c-bc2cbb47fee0 tempest-VolumesTransfersTest-1253152248 None] Lock "cinder-quobyte-085dd630-1f4d-45e9-ba34-cbc515f11864" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:10:44 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4d48a7-2830-465f-b3d8-50e8e8ec1f03]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:10:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9ade324c-526e-4212-815c-bc2cbb47fee0 tempest-VolumesTransfersTest-1253152248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-085dd630-1f4d-45e9-ba34-cbc515f11864 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:44 devstack sudo[94246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-085dd630-1f4d-45e9-ba34-cbc515f11864 Sep 01 12:10:44 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:45 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9ade324c-526e-4212-815c-bc2cbb47fee0 tempest-VolumesTransfersTest-1253152248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-085dd630-1f4d-45e9-ba34-cbc515f11864" returned: 0 in 0.668s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9ade324c-526e-4212-815c-bc2cbb47fee0 tempest-VolumesTransfersTest-1253152248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-085dd630-1f4d-45e9-ba34-cbc515f11864 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:45 devstack sudo[94251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-085dd630-1f4d-45e9-ba34-cbc515f11864 Sep 01 12:10:45 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-fd93ab1d-de30-487f-ab11-0608f4047c20 tempest-GroupsTest-939626981 None] Group tempest-Group1-1594884575: creating Sep 01 12:10:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-fd93ab1d-de30-487f-ab11-0608f4047c20 tempest-GroupsTest-939626981 None] Group tempest-Group1-1594884575: created successfully Sep 01 12:10:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-fd93ab1d-de30-487f-ab11-0608f4047c20 tempest-GroupsTest-939626981 None] Create group completed successfully. Sep 01 12:10:45 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9ade324c-526e-4212-815c-bc2cbb47fee0 tempest-VolumesTransfersTest-1253152248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-085dd630-1f4d-45e9-ba34-cbc515f11864" returned: 0 in 0.561s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9ade324c-526e-4212-815c-bc2cbb47fee0 tempest-VolumesTransfersTest-1253152248 None] Lock "cinder-quobyte-085dd630-1f4d-45e9-ba34-cbc515f11864" released by "delete_volume" :: held 1.303s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:10:45 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-9ade324c-526e-4212-815c-bc2cbb47fee0 tempest-VolumesTransfersTest-1253152248 None] Created reservations ['6a92144d-e929-4d3c-89cd-22a0fcd4bb52', '4c15b013-098a-41a1-94b8-ffe54bf2e82d', '6c90e0f5-5e49-4da3-ad96-62024822f1ef', '45811f82-a977-46ae-b128-1939891dd16a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:10:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9ade324c-526e-4212-815c-bc2cbb47fee0 tempest-VolumesTransfersTest-1253152248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9ade324c-526e-4212-815c-bc2cbb47fee0 tempest-VolumesTransfersTest-1253152248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9ade324c-526e-4212-815c-bc2cbb47fee0 tempest-VolumesTransfersTest-1253152248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:10:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9ade324c-526e-4212-815c-bc2cbb47fee0 tempest-VolumesTransfersTest-1253152248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:10:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9ade324c-526e-4212-815c-bc2cbb47fee0 tempest-VolumesTransfersTest-1253152248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9ade324c-526e-4212-815c-bc2cbb47fee0 tempest-VolumesTransfersTest-1253152248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:46 devstack sudo[94255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:10:46 devstack sudo[94255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:46 devstack sudo[94255]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9ade324c-526e-4212-815c-bc2cbb47fee0 tempest-VolumesTransfersTest-1253152248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.353s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:46 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-9ade324c-526e-4212-815c-bc2cbb47fee0 tempest-VolumesTransfersTest-1253152248 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:10:46 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9ade324c-526e-4212-815c-bc2cbb47fee0 tempest-VolumesTransfersTest-1253152248 None] Deleted volume successfully. Sep 01 12:10:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9ade324c-526e-4212-815c-bc2cbb47fee0 tempest-VolumesTransfersTest-1253152248 None] Lock "cinder-085dd630-1f4d-45e9-ba34-cbc515f11864-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:10:47 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-68691e24-305e-483c-bf6c-fffc6558889c tempest-GroupsTest-939626981 None] Group tempest-Group2-2088466114: creating Sep 01 12:10:47 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-68691e24-305e-483c-bf6c-fffc6558889c tempest-GroupsTest-939626981 None] Group tempest-Group2-2088466114: created successfully Sep 01 12:10:47 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-68691e24-305e-483c-bf6c-fffc6558889c tempest-GroupsTest-939626981 None] Create group completed successfully. Sep 01 12:10:48 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:10:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Flow 'volume_create_manager' (761eb8a2-a050-462c-aab3-5d5a3be2950f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:10:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfd8e80-e115-4090-a004-9acbd232503e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfd8e80-e115-4090-a004-9acbd232503e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1847877481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=992eeffe-dbdd-419d-bf1a-faf3ae248a53,host='devstack@QuobyteHD#QuobyteHD',id=18b37876-7de0-43ec-be90-c0fdf7191eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='104e37ba317243f2bf96b4a1020da51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:10:49Z,use_quota=True,user_id='a4f6710a6538492bbe9ca38bcf3a8be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd87359f-d6e9-4b13-8872-b0e6871fb3a7),volume_type_id=cd87359f-d6e9-4b13-8872-b0e6871fb3a7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c2a693-da6e-4d10-a703-f6846b5c5e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c2a693-da6e-4d10-a703-f6846b5c5e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fae4b9c1-3626-4ccd-9054-d915668a6dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fae4b9c1-3626-4ccd-9054-d915668a6dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18b37876-7de0-43ec-be90-c0fdf7191eea', 'volume_name': 'volume-18b37876-7de0-43ec-be90-c0fdf7191eea', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48466c88-7e2c-4a2c-8e01-da5dab7a65dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48466c88-7e2c-4a2c-8e01-da5dab7a65dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02539b9-bf36-43c7-a39e-32797c43304d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:49 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Volume 18b37876-7de0-43ec-be90-c0fdf7191eea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18b37876-7de0-43ec-be90-c0fdf7191eea', 'volume_size': 1} Sep 01 12:10:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=992eeffe-dbdd-419d-bf1a-faf3ae248a53,created_at=2026-09-01T10:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1847877481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=992eeffe-dbdd-419d-bf1a-faf3ae248a53,host='devstack@QuobyteHD#QuobyteHD',id=18b37876-7de0-43ec-be90-c0fdf7191eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='104e37ba317243f2bf96b4a1020da51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:10:49Z,use_quota=True,user_id='a4f6710a6538492bbe9ca38bcf3a8be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd87359f-d6e9-4b13-8872-b0e6871fb3a7),volume_type_id=cd87359f-d6e9-4b13-8872-b0e6871fb3a7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:10:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Creating volume 18b37876-7de0-43ec-be90-c0fdf7191eea {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:10:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:10:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:10:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:10:49 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:10:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-18b37876-7de0-43ec-be90-c0fdf7191eea 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:49 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-18b37876-7de0-43ec-be90-c0fdf7191eea 1073741824 Sep 01 12:10:49 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:49 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-18b37876-7de0-43ec-be90-c0fdf7191eea 1073741824" returned: 0 in 0.660s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-18b37876-7de0-43ec-be90-c0fdf7191eea {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:49 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-18b37876-7de0-43ec-be90-c0fdf7191eea Sep 01 12:10:49 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:50 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-18b37876-7de0-43ec-be90-c0fdf7191eea" returned: 0 in 0.316s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:10:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02539b9-bf36-43c7-a39e-32797c43304d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18b37876-7de0-43ec-be90-c0fdf7191eea', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d991948-67dc-4b03-a265-0be2c5c0a4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:50 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Volume volume-18b37876-7de0-43ec-be90-c0fdf7191eea (18b37876-7de0-43ec-be90-c0fdf7191eea): created successfully Sep 01 12:10:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d991948-67dc-4b03-a265-0be2c5c0a4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Flow 'volume_create_manager' (761eb8a2-a050-462c-aab3-5d5a3be2950f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:10:50 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8c0d8380-8dd3-4d55-ae0d-cd044928d0e7 tempest-GroupsTest-939626981 None] Created volume successfully. Sep 01 12:10:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-abf0f445-5b79-4180-b29c-b72ade84c4e6 tempest-GroupsTest-939626981 None] Acquiring lock "cinder-quobyte-18b37876-7de0-43ec-be90-c0fdf7191eea" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:10:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-abf0f445-5b79-4180-b29c-b72ade84c4e6 tempest-GroupsTest-939626981 None] Lock "cinder-quobyte-18b37876-7de0-43ec-be90-c0fdf7191eea" acquired by "delete_volume" :: waited 0.056s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:10:51 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[61155921-c84f-48ed-9911-f3886640ce68]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:10:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abf0f445-5b79-4180-b29c-b72ade84c4e6 tempest-GroupsTest-939626981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-18b37876-7de0-43ec-be90-c0fdf7191eea {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:51 devstack sudo[94271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-18b37876-7de0-43ec-be90-c0fdf7191eea Sep 01 12:10:51 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:51 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abf0f445-5b79-4180-b29c-b72ade84c4e6 tempest-GroupsTest-939626981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-18b37876-7de0-43ec-be90-c0fdf7191eea" returned: 0 in 0.538s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abf0f445-5b79-4180-b29c-b72ade84c4e6 tempest-GroupsTest-939626981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-18b37876-7de0-43ec-be90-c0fdf7191eea {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:51 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-18b37876-7de0-43ec-be90-c0fdf7191eea Sep 01 12:10:51 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:52 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abf0f445-5b79-4180-b29c-b72ade84c4e6 tempest-GroupsTest-939626981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-18b37876-7de0-43ec-be90-c0fdf7191eea" returned: 0 in 0.311s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-abf0f445-5b79-4180-b29c-b72ade84c4e6 tempest-GroupsTest-939626981 None] Lock "cinder-quobyte-18b37876-7de0-43ec-be90-c0fdf7191eea" released by "delete_volume" :: held 0.936s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:10:52 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-abf0f445-5b79-4180-b29c-b72ade84c4e6 tempest-GroupsTest-939626981 None] Created reservations ['db283a62-feac-4c13-bc38-e6dadda642ac'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:10:52 devstack cinder-volume[87084]: WARNING cinder.quota [None req-abf0f445-5b79-4180-b29c-b72ade84c4e6 tempest-GroupsTest-939626981 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2070329240 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2070329240, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:10:52 devstack cinder-volume[87084]: WARNING cinder.quota [None req-abf0f445-5b79-4180-b29c-b72ade84c4e6 tempest-GroupsTest-939626981 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2070329240 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2070329240, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:10:52 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-abf0f445-5b79-4180-b29c-b72ade84c4e6 tempest-GroupsTest-939626981 None] Created reservations ['08836f00-0381-45a2-8ec2-ce91c6522432', '44679408-05a6-446a-8a38-182214346a59', 'e8544ca0-6c56-4dbb-9d91-3b358b7e3223', 'c07b1981-72bb-4ac0-bb63-cb20f58f507b'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:10:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-abf0f445-5b79-4180-b29c-b72ade84c4e6 tempest-GroupsTest-939626981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-abf0f445-5b79-4180-b29c-b72ade84c4e6 tempest-GroupsTest-939626981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-abf0f445-5b79-4180-b29c-b72ade84c4e6 tempest-GroupsTest-939626981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:10:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-abf0f445-5b79-4180-b29c-b72ade84c4e6 tempest-GroupsTest-939626981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:10:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-abf0f445-5b79-4180-b29c-b72ade84c4e6 tempest-GroupsTest-939626981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abf0f445-5b79-4180-b29c-b72ade84c4e6 tempest-GroupsTest-939626981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:52 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:10:52 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:52 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abf0f445-5b79-4180-b29c-b72ade84c4e6 tempest-GroupsTest-939626981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.357s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:52 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-abf0f445-5b79-4180-b29c-b72ade84c4e6 tempest-GroupsTest-939626981 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:10:52 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-abf0f445-5b79-4180-b29c-b72ade84c4e6 tempest-GroupsTest-939626981 None] Delete group completed successfully. Sep 01 12:10:53 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-fc331d72-a54b-48f6-a5f4-d2ae8f140e22 tempest-GroupsTest-939626981 None] Created reservations ['68180d98-9035-47ae-91a8-d74410b19310'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:10:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fc331d72-a54b-48f6-a5f4-d2ae8f140e22 tempest-GroupsTest-939626981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fc331d72-a54b-48f6-a5f4-d2ae8f140e22 tempest-GroupsTest-939626981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fc331d72-a54b-48f6-a5f4-d2ae8f140e22 tempest-GroupsTest-939626981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:10:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fc331d72-a54b-48f6-a5f4-d2ae8f140e22 tempest-GroupsTest-939626981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:10:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fc331d72-a54b-48f6-a5f4-d2ae8f140e22 tempest-GroupsTest-939626981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fc331d72-a54b-48f6-a5f4-d2ae8f140e22 tempest-GroupsTest-939626981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:54 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:10:54 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:54 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fc331d72-a54b-48f6-a5f4-d2ae8f140e22 tempest-GroupsTest-939626981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.345s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:54 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-fc331d72-a54b-48f6-a5f4-d2ae8f140e22 tempest-GroupsTest-939626981 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:10:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-fc331d72-a54b-48f6-a5f4-d2ae8f140e22 tempest-GroupsTest-939626981 None] Delete group completed successfully. Sep 01 12:10:55 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-07987199-a9bd-49e0-840c-da66e7eeebfe tempest-GroupsTest-939626981 None] Group tempest-GroupsTest-Group-1674710467: creating Sep 01 12:10:55 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-07987199-a9bd-49e0-840c-da66e7eeebfe tempest-GroupsTest-939626981 None] Group tempest-GroupsTest-Group-1674710467: created successfully Sep 01 12:10:55 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-07987199-a9bd-49e0-840c-da66e7eeebfe tempest-GroupsTest-939626981 None] Create group completed successfully. Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Flow 'volume_create_manager' (6bb6e81f-e9be-4245-8f7d-2b55ff459ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d598c20-00b4-4fbd-85b1-8c877d231d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d598c20-00b4-4fbd-85b1-8c877d231d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2128362809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677cde68-0692-49c1-94b6-02f99b56c396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3363767eb354b29bce9bf3a11ab82a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:10:57Z,use_quota=True,user_id='ea0756a9efee4d57af36e2d279902ed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b917df76-f5c8-4f90-8a53-0168c0f93212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b917df76-f5c8-4f90-8a53-0168c0f93212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7158aa3c-5b27-488b-8d60-965f09663089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7158aa3c-5b27-488b-8d60-965f09663089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '677cde68-0692-49c1-94b6-02f99b56c396', 'volume_name': 'volume-677cde68-0692-49c1-94b6-02f99b56c396', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae5b2b2-7229-4a7b-87c0-52859eaa3ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae5b2b2-7229-4a7b-87c0-52859eaa3ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff81759c-dc81-420b-abe6-017282bac76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:57 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Volume 677cde68-0692-49c1-94b6-02f99b56c396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-677cde68-0692-49c1-94b6-02f99b56c396', 'volume_size': 1} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2128362809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677cde68-0692-49c1-94b6-02f99b56c396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3363767eb354b29bce9bf3a11ab82a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:10:57Z,use_quota=True,user_id='ea0756a9efee4d57af36e2d279902ed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Creating volume 677cde68-0692-49c1-94b6-02f99b56c396 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:10:57 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-677cde68-0692-49c1-94b6-02f99b56c396 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:57 devstack sudo[94302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-677cde68-0692-49c1-94b6-02f99b56c396 1073741824 Sep 01 12:10:57 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Flow 'volume_create_manager' (afd31735-06ec-412e-b4b7-b6c1f0cd5c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a56e95-0bc9-403d-b1f3-c5f69aaa41ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a56e95-0bc9-403d-b1f3-c5f69aaa41ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-705178316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4c1ad43d-9a91-4ff8-ac86-a9e43d4ae1c4,host='devstack@QuobyteHD#QuobyteHD',id=6d68b42b-f21e-4b5d-9f55-a9c66cd22704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='104e37ba317243f2bf96b4a1020da51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:10:57Z,use_quota=True,user_id='a4f6710a6538492bbe9ca38bcf3a8be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ceea35d9-147f-4d2a-9e77-2ae656bb3bef),volume_type_id=ceea35d9-147f-4d2a-9e77-2ae656bb3bef)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f2c002-3df1-42f0-a085-165ebb80452b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f2c002-3df1-42f0-a085-165ebb80452b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de5f362-bc4d-4d48-ae9f-871c9fe9750a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de5f362-bc4d-4d48-ae9f-871c9fe9750a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d68b42b-f21e-4b5d-9f55-a9c66cd22704', 'volume_name': 'volume-6d68b42b-f21e-4b5d-9f55-a9c66cd22704', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057c758e-c074-4d67-acde-00d4db41e4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057c758e-c074-4d67-acde-00d4db41e4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ec0ff2-550a-4e49-bc7c-ef1ccd03253c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:57 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Volume 6d68b42b-f21e-4b5d-9f55-a9c66cd22704: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d68b42b-f21e-4b5d-9f55-a9c66cd22704', 'volume_size': 1} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:57 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-677cde68-0692-49c1-94b6-02f99b56c396 1073741824" returned: 0 in 0.463s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-677cde68-0692-49c1-94b6-02f99b56c396 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:57 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-677cde68-0692-49c1-94b6-02f99b56c396 Sep 01 12:10:57 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:58 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-677cde68-0692-49c1-94b6-02f99b56c396" returned: 0 in 0.299s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.615s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4c1ad43d-9a91-4ff8-ac86-a9e43d4ae1c4,created_at=2026-09-01T10:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-705178316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4c1ad43d-9a91-4ff8-ac86-a9e43d4ae1c4,host='devstack@QuobyteHD#QuobyteHD',id=6d68b42b-f21e-4b5d-9f55-a9c66cd22704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='104e37ba317243f2bf96b4a1020da51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:10:57Z,use_quota=True,user_id='a4f6710a6538492bbe9ca38bcf3a8be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ceea35d9-147f-4d2a-9e77-2ae656bb3bef),volume_type_id=ceea35d9-147f-4d2a-9e77-2ae656bb3bef)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Creating volume 6d68b42b-f21e-4b5d-9f55-a9c66cd22704 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:10:58 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d68b42b-f21e-4b5d-9f55-a9c66cd22704 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff81759c-dc81-420b-abe6-017282bac76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-677cde68-0692-49c1-94b6-02f99b56c396', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:58 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d68b42b-f21e-4b5d-9f55-a9c66cd22704 1073741824 Sep 01 12:10:58 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3406fa-da2e-4cd8-8bdf-0879c9cad7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:58 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Volume volume-677cde68-0692-49c1-94b6-02f99b56c396 (677cde68-0692-49c1-94b6-02f99b56c396): created successfully Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3406fa-da2e-4cd8-8bdf-0879c9cad7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Flow 'volume_create_manager' (6bb6e81f-e9be-4245-8f7d-2b55ff459ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:10:58 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-88b4356a-38d9-4022-bd29-cfaab6f14b8b tempest-VolumesTransfersV357Test-25150776 None] Created volume successfully. Sep 01 12:10:58 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d68b42b-f21e-4b5d-9f55-a9c66cd22704 1073741824" returned: 0 in 0.507s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d68b42b-f21e-4b5d-9f55-a9c66cd22704 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:10:58 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d68b42b-f21e-4b5d-9f55-a9c66cd22704 Sep 01 12:10:58 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:10:58 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d68b42b-f21e-4b5d-9f55-a9c66cd22704" returned: 0 in 0.275s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ec0ff2-550a-4e49-bc7c-ef1ccd03253c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d68b42b-f21e-4b5d-9f55-a9c66cd22704', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1bcda1d-d8d8-4983-825b-2dfdc4560260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:10:58 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Volume volume-6d68b42b-f21e-4b5d-9f55-a9c66cd22704 (6d68b42b-f21e-4b5d-9f55-a9c66cd22704): created successfully Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1bcda1d-d8d8-4983-825b-2dfdc4560260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:10:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Flow 'volume_create_manager' (afd31735-06ec-412e-b4b7-b6c1f0cd5c90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:10:58 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1f3ef5cd-e69a-4043-a500-6564067c25ad tempest-GroupsTest-939626981 None] Created volume successfully. Sep 01 12:10:59 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5be2cc31-1026-449a-8b96-728caa610422 tempest-VolumesTransfersV357Test-1151306515 None] Transfer volume completed successfully. Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Flow 'volume_create_manager' (625ec49c-af7a-4ed0-b175-3c0a07d1c465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e995ee5c-27ad-430e-8016-d182cab2d9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e995ee5c-27ad-430e-8016-d182cab2d9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1330405313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4c1ad43d-9a91-4ff8-ac86-a9e43d4ae1c4,host='devstack@QuobyteHD#QuobyteHD',id=350f21eb-1135-45eb-af36-cf9c55f5e95c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='104e37ba317243f2bf96b4a1020da51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:11:01Z,use_quota=True,user_id='a4f6710a6538492bbe9ca38bcf3a8be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ceea35d9-147f-4d2a-9e77-2ae656bb3bef),volume_type_id=ceea35d9-147f-4d2a-9e77-2ae656bb3bef)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e8ce46-1e90-4655-b4d5-ac86bc8d7a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e8ce46-1e90-4655-b4d5-ac86bc8d7a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d3aceb-d574-457e-b783-f31eaba93e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d3aceb-d574-457e-b783-f31eaba93e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '350f21eb-1135-45eb-af36-cf9c55f5e95c', 'volume_name': 'volume-350f21eb-1135-45eb-af36-cf9c55f5e95c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (510f0fe7-9a4b-4dba-bf18-60cf00643b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (510f0fe7-9a4b-4dba-bf18-60cf00643b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847e32d4-1577-4836-8db5-4d1bf9ae0ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:00 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Volume 350f21eb-1135-45eb-af36-cf9c55f5e95c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-350f21eb-1135-45eb-af36-cf9c55f5e95c', 'volume_size': 1} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4c1ad43d-9a91-4ff8-ac86-a9e43d4ae1c4,created_at=2026-09-01T10:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1330405313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4c1ad43d-9a91-4ff8-ac86-a9e43d4ae1c4,host='devstack@QuobyteHD#QuobyteHD',id=350f21eb-1135-45eb-af36-cf9c55f5e95c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='104e37ba317243f2bf96b4a1020da51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:11:01Z,use_quota=True,user_id='a4f6710a6538492bbe9ca38bcf3a8be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ceea35d9-147f-4d2a-9e77-2ae656bb3bef),volume_type_id=ceea35d9-147f-4d2a-9e77-2ae656bb3bef)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Creating volume 350f21eb-1135-45eb-af36-cf9c55f5e95c {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:11:00 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-350f21eb-1135-45eb-af36-cf9c55f5e95c 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:00 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-350f21eb-1135-45eb-af36-cf9c55f5e95c 1073741824 Sep 01 12:11:00 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-89e3f827-dfc4-4bb4-a1b1-6ce83cd6ddea tempest-VolumesTransfersV357Test-1380143763 None] Acquiring lock "cinder-677cde68-0692-49c1-94b6-02f99b56c396-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-89e3f827-dfc4-4bb4-a1b1-6ce83cd6ddea tempest-VolumesTransfersV357Test-1380143763 None] Lock "cinder-677cde68-0692-49c1-94b6-02f99b56c396-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-89e3f827-dfc4-4bb4-a1b1-6ce83cd6ddea tempest-VolumesTransfersV357Test-1380143763 None] Acquiring lock "cinder-quobyte-677cde68-0692-49c1-94b6-02f99b56c396" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-89e3f827-dfc4-4bb4-a1b1-6ce83cd6ddea tempest-VolumesTransfersV357Test-1380143763 None] Lock "cinder-quobyte-677cde68-0692-49c1-94b6-02f99b56c396" acquired by "delete_volume" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d721324-e4f1-4ede-8fb4-bc1694b4c618]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:11:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-89e3f827-dfc4-4bb4-a1b1-6ce83cd6ddea tempest-VolumesTransfersV357Test-1380143763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-677cde68-0692-49c1-94b6-02f99b56c396 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:01 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-677cde68-0692-49c1-94b6-02f99b56c396 Sep 01 12:11:01 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:01 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-350f21eb-1135-45eb-af36-cf9c55f5e95c 1073741824" returned: 0 in 0.613s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:01 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-350f21eb-1135-45eb-af36-cf9c55f5e95c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-89e3f827-dfc4-4bb4-a1b1-6ce83cd6ddea tempest-VolumesTransfersV357Test-1380143763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-677cde68-0692-49c1-94b6-02f99b56c396" returned: 0 in 0.469s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-89e3f827-dfc4-4bb4-a1b1-6ce83cd6ddea tempest-VolumesTransfersV357Test-1380143763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-677cde68-0692-49c1-94b6-02f99b56c396 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:01 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-350f21eb-1135-45eb-af36-cf9c55f5e95c Sep 01 12:11:01 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:01 devstack sudo[94343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-677cde68-0692-49c1-94b6-02f99b56c396 Sep 01 12:11:01 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:01 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-89e3f827-dfc4-4bb4-a1b1-6ce83cd6ddea tempest-VolumesTransfersV357Test-1380143763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-677cde68-0692-49c1-94b6-02f99b56c396" returned: 0 in 0.288s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:01 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-89e3f827-dfc4-4bb4-a1b1-6ce83cd6ddea tempest-VolumesTransfersV357Test-1380143763 None] Lock "cinder-quobyte-677cde68-0692-49c1-94b6-02f99b56c396" released by "delete_volume" :: held 0.811s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:11:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-350f21eb-1135-45eb-af36-cf9c55f5e95c" returned: 0 in 0.332s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:11:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847e32d4-1577-4836-8db5-4d1bf9ae0ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-350f21eb-1135-45eb-af36-cf9c55f5e95c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c53b5d-c0d2-4726-8bc0-b58087861037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:01 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Volume volume-350f21eb-1135-45eb-af36-cf9c55f5e95c (350f21eb-1135-45eb-af36-cf9c55f5e95c): created successfully Sep 01 12:11:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c53b5d-c0d2-4726-8bc0-b58087861037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Flow 'volume_create_manager' (625ec49c-af7a-4ed0-b175-3c0a07d1c465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:11:01 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8f5af16a-ead5-4c4f-ba2f-581368d77df4 tempest-GroupsTest-939626981 None] Created volume successfully. Sep 01 12:11:01 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-89e3f827-dfc4-4bb4-a1b1-6ce83cd6ddea tempest-VolumesTransfersV357Test-1380143763 None] Created reservations ['9412deda-5af1-4954-af9d-b55c4ec52350', 'f9778cd4-b044-4b67-b512-13809499fd1c', 'c2ee2128-aeb0-454f-8b60-6141259a2574', 'c75ec60a-44c4-4740-be52-c684f9979986'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:11:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-89e3f827-dfc4-4bb4-a1b1-6ce83cd6ddea tempest-VolumesTransfersV357Test-1380143763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-89e3f827-dfc4-4bb4-a1b1-6ce83cd6ddea tempest-VolumesTransfersV357Test-1380143763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-89e3f827-dfc4-4bb4-a1b1-6ce83cd6ddea tempest-VolumesTransfersV357Test-1380143763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:11:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-89e3f827-dfc4-4bb4-a1b1-6ce83cd6ddea tempest-VolumesTransfersV357Test-1380143763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:11:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-89e3f827-dfc4-4bb4-a1b1-6ce83cd6ddea tempest-VolumesTransfersV357Test-1380143763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-89e3f827-dfc4-4bb4-a1b1-6ce83cd6ddea tempest-VolumesTransfersV357Test-1380143763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:01 devstack sudo[94348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:11:01 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:02 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-89e3f827-dfc4-4bb4-a1b1-6ce83cd6ddea tempest-VolumesTransfersV357Test-1380143763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.340s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-89e3f827-dfc4-4bb4-a1b1-6ce83cd6ddea tempest-VolumesTransfersV357Test-1380143763 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:11:02 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-89e3f827-dfc4-4bb4-a1b1-6ce83cd6ddea tempest-VolumesTransfersV357Test-1380143763 None] Deleted volume successfully. Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-89e3f827-dfc4-4bb4-a1b1-6ce83cd6ddea tempest-VolumesTransfersV357Test-1380143763 None] Lock "cinder-677cde68-0692-49c1-94b6-02f99b56c396-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Flow 'volume_create_manager' (952e4de0-7f1c-4d26-ba5c-cf66423de7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778f497f-9b80-4a4c-a595-089e69fc2eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778f497f-9b80-4a4c-a595-089e69fc2eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-523599117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ea22c7-be05-42ec-bb8f-b86fff63d00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3363767eb354b29bce9bf3a11ab82a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:11:03Z,use_quota=True,user_id='ea0756a9efee4d57af36e2d279902ed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5916b2-6c2f-4127-b93c-1843876dfdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5916b2-6c2f-4127-b93c-1843876dfdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3fced6-aaf4-4db1-8ebc-7019897b769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3fced6-aaf4-4db1-8ebc-7019897b769d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68ea22c7-be05-42ec-bb8f-b86fff63d00e', 'volume_name': 'volume-68ea22c7-be05-42ec-bb8f-b86fff63d00e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19411a63-6047-494f-a8f6-f3f092e9e443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19411a63-6047-494f-a8f6-f3f092e9e443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe0ed76-1ba5-416f-9794-d065c3bf21ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:02 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Volume 68ea22c7-be05-42ec-bb8f-b86fff63d00e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68ea22c7-be05-42ec-bb8f-b86fff63d00e', 'volume_size': 1} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-523599117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ea22c7-be05-42ec-bb8f-b86fff63d00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3363767eb354b29bce9bf3a11ab82a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:11:03Z,use_quota=True,user_id='ea0756a9efee4d57af36e2d279902ed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Creating volume 68ea22c7-be05-42ec-bb8f-b86fff63d00e {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:11:02 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:11:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-68ea22c7-be05-42ec-bb8f-b86fff63d00e 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:02 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-68ea22c7-be05-42ec-bb8f-b86fff63d00e 1073741824 Sep 01 12:11:02 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Flow 'volume_create_manager' (350a480f-0a18-4396-9a34-cace1d037033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4daa698-b89c-41cd-b200-0667c430f78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4daa698-b89c-41cd-b200-0667c430f78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1136838435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c35308f-0ed6-41c6-b8f1-d8d8582b254f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6611281855498887c70bd8c31fa749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:11:03Z,use_quota=True,user_id='76a84abe3b634f77af10b293c0c1ef95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10382e61-6c02-465b-b877-3b651e501d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10382e61-6c02-465b-b877-3b651e501d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086c78e6-331a-4cdb-8557-dfc32796195d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086c78e6-331a-4cdb-8557-dfc32796195d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c35308f-0ed6-41c6-b8f1-d8d8582b254f', 'volume_name': 'volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58cf85c8-5612-4b6c-a273-cb4b8e5e8147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58cf85c8-5612-4b6c-a273-cb4b8e5e8147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7024867-7e5f-4ce0-a80a-e55a802aa288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:03 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Volume 0c35308f-0ed6-41c6-b8f1-d8d8582b254f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f', 'volume_size': 1} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c2a2d649-2c07-4cfd-a37a-f68607da47de tempest-GroupsTest-939626981 None] Update group completed successfully. Sep 01 12:11:03 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-68ea22c7-be05-42ec-bb8f-b86fff63d00e 1073741824" returned: 0 in 0.496s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-68ea22c7-be05-42ec-bb8f-b86fff63d00e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:03 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-68ea22c7-be05-42ec-bb8f-b86fff63d00e Sep 01 12:11:03 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:03 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-68ea22c7-be05-42ec-bb8f-b86fff63d00e" returned: 0 in 0.252s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.522s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1136838435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c35308f-0ed6-41c6-b8f1-d8d8582b254f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6611281855498887c70bd8c31fa749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:11:03Z,use_quota=True,user_id='76a84abe3b634f77af10b293c0c1ef95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Creating volume 0c35308f-0ed6-41c6-b8f1-d8d8582b254f {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:11:03 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe0ed76-1ba5-416f-9794-d065c3bf21ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68ea22c7-be05-42ec-bb8f-b86fff63d00e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:03 devstack sudo[94360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f 1073741824 Sep 01 12:11:03 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b2a24b-799d-44bb-9fcc-a025873be856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:03 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Volume volume-68ea22c7-be05-42ec-bb8f-b86fff63d00e (68ea22c7-be05-42ec-bb8f-b86fff63d00e): created successfully Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b2a24b-799d-44bb-9fcc-a025873be856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Flow 'volume_create_manager' (952e4de0-7f1c-4d26-ba5c-cf66423de7b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:11:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6de51a9d-7d87-4476-a966-eb50d9ae043d tempest-VolumesTransfersV357Test-25150776 None] Created volume successfully. Sep 01 12:11:04 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f 1073741824" returned: 0 in 0.411s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:04 devstack sudo[94366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f Sep 01 12:11:04 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:04 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f" returned: 0 in 0.239s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:11:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7024867-7e5f-4ce0-a80a-e55a802aa288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc511ecf-500f-43c3-a392-5fc16abf2a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:04 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Volume volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f (0c35308f-0ed6-41c6-b8f1-d8d8582b254f): created successfully Sep 01 12:11:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc511ecf-500f-43c3-a392-5fc16abf2a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Flow 'volume_create_manager' (350a480f-0a18-4396-9a34-cace1d037033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:11:04 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e4544991-bbd0-42ff-bb46-fb19277c69e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Created volume successfully. Sep 01 12:11:04 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-84c18a28-632a-487d-8c06-0ecafb428a55 tempest-GroupsTest-939626981 None] Update group completed successfully. Sep 01 12:11:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bd37d894-fabc-485c-bb0d-97d14e969b50 tempest-VolumesTransfersV357Test-1380143763 None] Acquiring lock "cinder-68ea22c7-be05-42ec-bb8f-b86fff63d00e-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:11:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bd37d894-fabc-485c-bb0d-97d14e969b50 tempest-VolumesTransfersV357Test-1380143763 None] Lock "cinder-68ea22c7-be05-42ec-bb8f-b86fff63d00e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:11:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bd37d894-fabc-485c-bb0d-97d14e969b50 tempest-VolumesTransfersV357Test-1380143763 None] Acquiring lock "cinder-quobyte-68ea22c7-be05-42ec-bb8f-b86fff63d00e" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:11:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bd37d894-fabc-485c-bb0d-97d14e969b50 tempest-VolumesTransfersV357Test-1380143763 None] Lock "cinder-quobyte-68ea22c7-be05-42ec-bb8f-b86fff63d00e" acquired by "delete_volume" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:11:05 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[85eb3e6f-db8e-4e4e-b4bd-dc0ac0a694af]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:11:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bd37d894-fabc-485c-bb0d-97d14e969b50 tempest-VolumesTransfersV357Test-1380143763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-68ea22c7-be05-42ec-bb8f-b86fff63d00e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3dc75f2c-0eb0-4ac1-9a46-5bfc8627bc83 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3dc75f2c-0eb0-4ac1-9a46-5bfc8627bc83 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-3dc75f2c-0eb0-4ac1-9a46-5bfc8627bc83 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Creating offline snapshot f97f458f-1b52-4dfa-ac22-a1aab1c68464 of volume 0c35308f-0ed6-41c6-b8f1-d8d8582b254f {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:11:05 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1ceaa3-0843-43d3-ac4d-6f4c573c63a0]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:11:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3dc75f2c-0eb0-4ac1-9a46-5bfc8627bc83 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:05 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-68ea22c7-be05-42ec-bb8f-b86fff63d00e Sep 01 12:11:05 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:05 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f Sep 01 12:11:05 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:05 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bd37d894-fabc-485c-bb0d-97d14e969b50 tempest-VolumesTransfersV357Test-1380143763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-68ea22c7-be05-42ec-bb8f-b86fff63d00e" returned: 0 in 0.376s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bd37d894-fabc-485c-bb0d-97d14e969b50 tempest-VolumesTransfersV357Test-1380143763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-68ea22c7-be05-42ec-bb8f-b86fff63d00e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:05 devstack sudo[94378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-68ea22c7-be05-42ec-bb8f-b86fff63d00e Sep 01 12:11:05 devstack sudo[94378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:05 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3dc75f2c-0eb0-4ac1-9a46-5bfc8627bc83 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f" returned: 0 in 0.415s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3dc75f2c-0eb0-4ac1-9a46-5bfc8627bc83 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.f97f458f-1b52-4dfa-ac22-a1aab1c68464 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:05 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.f97f458f-1b52-4dfa-ac22-a1aab1c68464 1G Sep 01 12:11:05 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:05 devstack sudo[94378]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bd37d894-fabc-485c-bb0d-97d14e969b50 tempest-VolumesTransfersV357Test-1380143763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-68ea22c7-be05-42ec-bb8f-b86fff63d00e" returned: 0 in 0.292s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bd37d894-fabc-485c-bb0d-97d14e969b50 tempest-VolumesTransfersV357Test-1380143763 None] Lock "cinder-quobyte-68ea22c7-be05-42ec-bb8f-b86fff63d00e" released by "delete_volume" :: held 0.716s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:11:05 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=132,cinder:SELECT=123,cinder:INSERT=32,cinder:DELETE=9 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:11:05 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=135,cinder:SELECT=119,cinder:INSERT=24,cinder:DELETE=6 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-bd37d894-fabc-485c-bb0d-97d14e969b50 tempest-VolumesTransfersV357Test-1380143763 None] Created reservations ['edd469ea-6d15-4f1a-9d1c-35e9000665a8', 'ef06f8b1-6eb4-4c79-a464-640ceee7d6cd', '57326618-58c5-4b07-a79d-9f0466691e74', '234f586f-8e22-4841-9917-0f65cd7cd300'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bd37d894-fabc-485c-bb0d-97d14e969b50 tempest-VolumesTransfersV357Test-1380143763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bd37d894-fabc-485c-bb0d-97d14e969b50 tempest-VolumesTransfersV357Test-1380143763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-bd37d894-fabc-485c-bb0d-97d14e969b50 tempest-VolumesTransfersV357Test-1380143763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-bd37d894-fabc-485c-bb0d-97d14e969b50 tempest-VolumesTransfersV357Test-1380143763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bd37d894-fabc-485c-bb0d-97d14e969b50 tempest-VolumesTransfersV357Test-1380143763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bd37d894-fabc-485c-bb0d-97d14e969b50 tempest-VolumesTransfersV357Test-1380143763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:06 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:11:06 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:06 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3dc75f2c-0eb0-4ac1-9a46-5bfc8627bc83 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.f97f458f-1b52-4dfa-ac22-a1aab1c68464 1G" returned: 0 in 0.668s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3dc75f2c-0eb0-4ac1-9a46-5bfc8627bc83 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.f97f458f-1b52-4dfa-ac22-a1aab1c68464 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:11:06 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.f97f458f-1b52-4dfa-ac22-a1aab1c68464 Sep 01 12:11:06 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Flow 'volume_create_manager' (8852633f-b241-4655-a9ff-41c9d10d07e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c290974-ba32-402d-a7e7-fc52ab6bbcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:06 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bd37d894-fabc-485c-bb0d-97d14e969b50 tempest-VolumesTransfersV357Test-1380143763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.455s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-bd37d894-fabc-485c-bb0d-97d14e969b50 tempest-VolumesTransfersV357Test-1380143763 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c290974-ba32-402d-a7e7-fc52ab6bbcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2134319983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd47cfa-25d9-4faa-8a78-ddca0884c735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45adfb8343b1471fbeb0dba60d3871a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:11:06Z,use_quota=True,user_id='8d092eec539142e49debd3e4143de052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee1e5c42-2b24-42ee-b85a-d3b8a815a926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee1e5c42-2b24-42ee-b85a-d3b8a815a926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e675064-77ec-4e08-b21c-7cbbc0a78f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e675064-77ec-4e08-b21c-7cbbc0a78f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecd47cfa-25d9-4faa-8a78-ddca0884c735', 'volume_name': 'volume-ecd47cfa-25d9-4faa-8a78-ddca0884c735', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f551490-566f-40ad-86bf-e5a5b4fd77b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f551490-566f-40ad-86bf-e5a5b4fd77b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a0c5fa-1221-4d55-bf9f-b388dac2066e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:06 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Volume ecd47cfa-25d9-4faa-8a78-ddca0884c735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecd47cfa-25d9-4faa-8a78-ddca0884c735', 'volume_size': 1} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:06 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-bd37d894-fabc-485c-bb0d-97d14e969b50 tempest-VolumesTransfersV357Test-1380143763 None] Deleted volume successfully. Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Acquiring lock "cinder-quobyte-350f21eb-1135-45eb-af36-cf9c55f5e95c" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bd37d894-fabc-485c-bb0d-97d14e969b50 tempest-VolumesTransfersV357Test-1380143763 None] Lock "cinder-68ea22c7-be05-42ec-bb8f-b86fff63d00e-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Lock "cinder-quobyte-350f21eb-1135-45eb-af36-cf9c55f5e95c" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3bd483-e92b-43be-a9a5-76116b2ac747]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-350f21eb-1135-45eb-af36-cf9c55f5e95c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:06 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-350f21eb-1135-45eb-af36-cf9c55f5e95c Sep 01 12:11:06 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:06 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3dc75f2c-0eb0-4ac1-9a46-5bfc8627bc83 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.f97f458f-1b52-4dfa-ac22-a1aab1c68464" returned: 0 in 0.368s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:06 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-3dc75f2c-0eb0-4ac1-9a46-5bfc8627bc83 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.f97f458f-1b52-4dfa-ac22-a1aab1c68464 is being set with open permissions: ugo+rw Sep 01 12:11:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3dc75f2c-0eb0-4ac1-9a46-5bfc8627bc83 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.f97f458f-1b52-4dfa-ac22-a1aab1c68464 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:06 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.f97f458f-1b52-4dfa-ac22-a1aab1c68464 Sep 01 12:11:06 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:07 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-350f21eb-1135-45eb-af36-cf9c55f5e95c" returned: 0 in 0.381s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-350f21eb-1135-45eb-af36-cf9c55f5e95c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:07 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3dc75f2c-0eb0-4ac1-9a46-5bfc8627bc83 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.f97f458f-1b52-4dfa-ac22-a1aab1c68464" returned: 0 in 0.274s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:07 devstack sudo[94405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-350f21eb-1135-45eb-af36-cf9c55f5e95c Sep 01 12:11:07 devstack sudo[94405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3dc75f2c-0eb0-4ac1-9a46-5bfc8627bc83 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:07 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.info Sep 01 12:11:07 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:07 devstack sudo[94405]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-350f21eb-1135-45eb-af36-cf9c55f5e95c" returned: 0 in 0.319s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Lock "cinder-quobyte-350f21eb-1135-45eb-af36-cf9c55f5e95c" released by "delete_volume" :: held 0.764s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Acquiring lock "cinder-quobyte-6d68b42b-f21e-4b5d-9f55-a9c66cd22704" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Lock "cinder-quobyte-6d68b42b-f21e-4b5d-9f55-a9c66cd22704" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:11:07 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3dc75f2c-0eb0-4ac1-9a46-5bfc8627bc83 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.info" returned: 0 in 0.330s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:07 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-3dc75f2c-0eb0-4ac1-9a46-5bfc8627bc83 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.info is being set with open permissions: ugo+rw Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3dc75f2c-0eb0-4ac1-9a46-5bfc8627bc83 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[87609f7a-7ae4-4a68-8ad0-52bfc02caab6]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d68b42b-f21e-4b5d-9f55-a9c66cd22704 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:07 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.info Sep 01 12:11:07 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:07 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d68b42b-f21e-4b5d-9f55-a9c66cd22704 Sep 01 12:11:07 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:07 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3dc75f2c-0eb0-4ac1-9a46-5bfc8627bc83 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.info" returned: 0 in 0.264s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3dc75f2c-0eb0-4ac1-9a46-5bfc8627bc83 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.438s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.149s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2134319983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd47cfa-25d9-4faa-8a78-ddca0884c735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45adfb8343b1471fbeb0dba60d3871a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:11:06Z,use_quota=True,user_id='8d092eec539142e49debd3e4143de052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Creating volume ecd47cfa-25d9-4faa-8a78-ddca0884c735 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:11:07 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd47cfa-25d9-4faa-8a78-ddca0884c735 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:07 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd47cfa-25d9-4faa-8a78-ddca0884c735 1073741824 Sep 01 12:11:07 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:07 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3dc75f2c-0eb0-4ac1-9a46-5bfc8627bc83 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Create snapshot completed successfully Sep 01 12:11:07 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d68b42b-f21e-4b5d-9f55-a9c66cd22704" returned: 0 in 0.418s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d68b42b-f21e-4b5d-9f55-a9c66cd22704 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:07 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d68b42b-f21e-4b5d-9f55-a9c66cd22704 Sep 01 12:11:07 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:08 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d68b42b-f21e-4b5d-9f55-a9c66cd22704" returned: 0 in 0.302s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Lock "cinder-quobyte-6d68b42b-f21e-4b5d-9f55-a9c66cd22704" released by "delete_volume" :: held 0.771s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Created reservations ['f30e88e4-ba36-45d5-92ea-5fe852e9d0ed'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:11:08 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd47cfa-25d9-4faa-8a78-ddca0884c735 1073741824" returned: 0 in 0.539s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:08 devstack cinder-volume[87084]: WARNING cinder.quota [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1786989633 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1786989633, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:11:08 devstack cinder-volume[87084]: WARNING cinder.quota [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1786989633 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1786989633, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Created reservations ['4aeff38c-67eb-447a-99bf-a3fb4f9f9be2', '5465d8d2-f3e8-4930-b9b1-292e98a42bb9', 'ccf29189-6f1a-4de5-830a-664b70bc4a2c', '4bb7e345-f095-4e99-95ac-08400da51cfe'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd47cfa-25d9-4faa-8a78-ddca0884c735 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:08 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd47cfa-25d9-4faa-8a78-ddca0884c735 Sep 01 12:11:08 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Created reservations ['f8dccad1-e0aa-4ee8-ba2b-05457e046e33', 'a01d50d6-7043-462e-86fd-9af1f4e985ef', 'eb9f8cfb-07c8-464d-a7ef-c645c3487d64', 'd5396d23-9fb8-47ba-9c57-5773c1de01af'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:08 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:11:08 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:08 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd47cfa-25d9-4faa-8a78-ddca0884c735" returned: 0 in 0.372s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a0c5fa-1221-4d55-bf9f-b388dac2066e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecd47cfa-25d9-4faa-8a78-ddca0884c735', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec68503-d229-4eb9-873f-3f1ada16666e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:08 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Volume volume-ecd47cfa-25d9-4faa-8a78-ddca0884c735 (ecd47cfa-25d9-4faa-8a78-ddca0884c735): created successfully Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec68503-d229-4eb9-873f-3f1ada16666e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Flow 'volume_create_manager' (8852633f-b241-4655-a9ff-41c9d10d07e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:11:08 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-daca1fe7-f07b-448b-99ab-6b22e9fb6815 tempest-AttachVolumeShelveTestJSON-2116667393 None] Created volume successfully. Sep 01 12:11:08 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.292s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:08 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:11:08 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9fa2ee71-30f0-490a-b546-b371efc1f4f3 tempest-GroupsTest-939626981 None] Delete group completed successfully. Sep 01 12:11:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Acquiring lock "cinder-f97f458f-1b52-4dfa-ac22-a1aab1c68464-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:11:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Lock "cinder-f97f458f-1b52-4dfa-ac22-a1aab1c68464-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:11:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Acquiring lock "cinder-quobyte-0c35308f-0ed6-41c6-b8f1-d8d8582b254f" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:11:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Lock "cinder-quobyte-0c35308f-0ed6-41c6-b8f1-d8d8582b254f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:11:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Acquiring lock "cinder-quobyte-f97f458f-1b52-4dfa-ac22-a1aab1c68464" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:11:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Lock "cinder-quobyte-f97f458f-1b52-4dfa-ac22-a1aab1c68464" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:11:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Deleting offline snapshot f97f458f-1b52-4dfa-ac22-a1aab1c68464 of volume 0c35308f-0ed6-41c6-b8f1-d8d8582b254f {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:11:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] snapshot_file for this snap is: volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.f97f458f-1b52-4dfa-ac22-a1aab1c68464 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:11:09 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff66f239-cfed-447f-9ef1-aa264914e320]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:11:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.f97f458f-1b52-4dfa-ac22-a1aab1c68464 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:09 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.f97f458f-1b52-4dfa-ac22-a1aab1c68464 Sep 01 12:11:09 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:09 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.f97f458f-1b52-4dfa-ac22-a1aab1c68464" returned: 0 in 0.487s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:11:09 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d4407e-f3ff-4b54-ac8f-7f6d769fa06e]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:11:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:10 devstack sudo[94443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f Sep 01 12:11:10 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:10 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f" returned: 0 in 0.526s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.f97f458f-1b52-4dfa-ac22-a1aab1c68464 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:10 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.f97f458f-1b52-4dfa-ac22-a1aab1c68464 Sep 01 12:11:10 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:10 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.f97f458f-1b52-4dfa-ac22-a1aab1c68464" returned: 0 in 0.438s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.f97f458f-1b52-4dfa-ac22-a1aab1c68464 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:10 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.f97f458f-1b52-4dfa-ac22-a1aab1c68464 Sep 01 12:11:10 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:11 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f.f97f458f-1b52-4dfa-ac22-a1aab1c68464" returned: 0 in 0.431s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Lock "cinder-quobyte-f97f458f-1b52-4dfa-ac22-a1aab1c68464" released by "_delete_snapshot" :: held 2.071s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:11:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Lock "cinder-quobyte-0c35308f-0ed6-41c6-b8f1-d8d8582b254f" released by "delete_snapshot" :: held 2.103s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:11:11 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Created reservations ['8d3f8124-bd94-4246-91d8-acf3e7f0fd7e', '14f87391-cfcd-4ab1-b0d9-cfaf1e031523', '0efb219d-d9f2-4a72-bc21-4645ccf76bfe', '950823ef-ab85-421a-a8d3-69eb6405ab13'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:11:11 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Delete snapshot completed successfully. Sep 01 12:11:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7e894409-53ba-456a-9d30-ec7240dc205e tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Lock "cinder-f97f458f-1b52-4dfa-ac22-a1aab1c68464-delete_snapshot" released by "delete_snapshot" :: held 2.310s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:11:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d87c5df0-a2e6-4166-9aad-cacdad268dd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Acquiring lock "cinder-0c35308f-0ed6-41c6-b8f1-d8d8582b254f-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:11:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d87c5df0-a2e6-4166-9aad-cacdad268dd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Lock "cinder-0c35308f-0ed6-41c6-b8f1-d8d8582b254f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:11:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d87c5df0-a2e6-4166-9aad-cacdad268dd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Acquiring lock "cinder-quobyte-0c35308f-0ed6-41c6-b8f1-d8d8582b254f" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:11:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d87c5df0-a2e6-4166-9aad-cacdad268dd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Lock "cinder-quobyte-0c35308f-0ed6-41c6-b8f1-d8d8582b254f" acquired by "delete_volume" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:11:12 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d0b474-5019-484c-b70e-4e34d995fb1b]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:11:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d87c5df0-a2e6-4166-9aad-cacdad268dd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:12 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f Sep 01 12:11:12 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:13 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d87c5df0-a2e6-4166-9aad-cacdad268dd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f" returned: 0 in 0.639s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d87c5df0-a2e6-4166-9aad-cacdad268dd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:13 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f Sep 01 12:11:13 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:13 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d87c5df0-a2e6-4166-9aad-cacdad268dd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0c35308f-0ed6-41c6-b8f1-d8d8582b254f" returned: 0 in 0.329s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d87c5df0-a2e6-4166-9aad-cacdad268dd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Lock "cinder-quobyte-0c35308f-0ed6-41c6-b8f1-d8d8582b254f" released by "delete_volume" :: held 1.042s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:11:13 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-d87c5df0-a2e6-4166-9aad-cacdad268dd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Created reservations ['8648e92f-01c5-4083-ad97-3fd2f5b52b4a', 'afcb6108-2a54-486c-a38c-7e7ca545d398', 'f7133c0f-7327-4aa4-ad7c-853c388f0a58', '9a7a537b-52cb-4637-9e11-0c6896260bf7'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:11:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d87c5df0-a2e6-4166-9aad-cacdad268dd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d87c5df0-a2e6-4166-9aad-cacdad268dd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d87c5df0-a2e6-4166-9aad-cacdad268dd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:11:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d87c5df0-a2e6-4166-9aad-cacdad268dd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:11:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d87c5df0-a2e6-4166-9aad-cacdad268dd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d87c5df0-a2e6-4166-9aad-cacdad268dd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:14 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:11:14 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d87c5df0-a2e6-4166-9aad-cacdad268dd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.417s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:14 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:14 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-d87c5df0-a2e6-4166-9aad-cacdad268dd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:11:14 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d87c5df0-a2e6-4166-9aad-cacdad268dd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Deleted volume successfully. Sep 01 12:11:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d87c5df0-a2e6-4166-9aad-cacdad268dd6 tempest-VolumeSnapshotQuotasNegativeTestJSON-7488127 None] Lock "cinder-0c35308f-0ed6-41c6-b8f1-d8d8582b254f-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Flow 'volume_create_manager' (a699d4c4-b2f7-484a-beca-a51729312a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3cd2b2a-1a97-41ca-9e26-b7d91b46b241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3cd2b2a-1a97-41ca-9e26-b7d91b46b241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1036056926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1793449d-6802-4fd3-9884-e5357fb8fbbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b3d371aaaa4332a72cc419054a9708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:11:23Z,use_quota=True,user_id='8777e57737e945089b91e5559491e7cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb2a83b-289d-4c28-8dbf-3bff231686a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb2a83b-289d-4c28-8dbf-3bff231686a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10a6617-1628-4d84-b3a3-0d35db2511c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10a6617-1628-4d84-b3a3-0d35db2511c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1793449d-6802-4fd3-9884-e5357fb8fbbe', 'volume_name': 'volume-1793449d-6802-4fd3-9884-e5357fb8fbbe', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0a6ff6-2813-408b-9d46-b97acf1d7520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0a6ff6-2813-408b-9d46-b97acf1d7520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3df6a02-9e68-42d3-b8dd-be9d94fcb35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:23 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Volume 1793449d-6802-4fd3-9884-e5357fb8fbbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1793449d-6802-4fd3-9884-e5357fb8fbbe', 'volume_size': 1} Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1036056926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1793449d-6802-4fd3-9884-e5357fb8fbbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b3d371aaaa4332a72cc419054a9708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:11:23Z,use_quota=True,user_id='8777e57737e945089b91e5559491e7cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Creating volume 1793449d-6802-4fd3-9884-e5357fb8fbbe {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:11:23 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:11:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:23 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe 1073741824 Sep 01 12:11:23 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:24 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe 1073741824" returned: 0 in 0.634s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:24 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe Sep 01 12:11:24 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:24 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe" returned: 0 in 0.535s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:11:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3df6a02-9e68-42d3-b8dd-be9d94fcb35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1793449d-6802-4fd3-9884-e5357fb8fbbe', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310d2ca9-6440-474b-840a-a85724ecf746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:24 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Volume volume-1793449d-6802-4fd3-9884-e5357fb8fbbe (1793449d-6802-4fd3-9884-e5357fb8fbbe): created successfully Sep 01 12:11:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310d2ca9-6440-474b-840a-a85724ecf746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Flow 'volume_create_manager' (a699d4c4-b2f7-484a-beca-a51729312a33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:11:24 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8cff2eca-ae59-471b-bf21-b0c6e4f38f4b tempest-VolumesActionsTest-1404060246 None] Created volume successfully. Sep 01 12:11:27 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-a557322c-22f2-4293-82f8-2babffe2f788 req-7c246aa7-5885-414a-be66-f4e5dec89786 tempest-AttachVolumeShelveTestJSON-2116667393 None] No connector for attachment 1f14f1bf-f6dc-4710-aefc-bde7b5d2a5ca; skipping storage backend terminate_connection call. {{(pid=87084) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 01 12:11:27 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-a557322c-22f2-4293-82f8-2babffe2f788 req-7c246aa7-5885-414a-be66-f4e5dec89786 tempest-AttachVolumeShelveTestJSON-2116667393 None] Deleting attachment 1f14f1bf-f6dc-4710-aefc-bde7b5d2a5ca. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:11:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2b0192b8-be0f-4653-8821-51bddfa33e0e tempest-VolumesActionsTest-1404060246 None] Acquiring lock "cinder-1793449d-6802-4fd3-9884-e5357fb8fbbe" by "attach_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:11:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2b0192b8-be0f-4653-8821-51bddfa33e0e tempest-VolumesActionsTest-1404060246 None] Lock "cinder-1793449d-6802-4fd3-9884-e5357fb8fbbe" acquired by "attach_volume" :: waited 0.037s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:11:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2b0192b8-be0f-4653-8821-51bddfa33e0e tempest-VolumesActionsTest-1404060246 None] Attaching volume 1793449d-6802-4fd3-9884-e5357fb8fbbe to instance 9e118729-ff6c-4588-a06e-d1fb0256676d at mountpoint /dev/vdb on host None. Sep 01 12:11:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2b0192b8-be0f-4653-8821-51bddfa33e0e tempest-VolumesActionsTest-1404060246 None] Attach volume completed successfully. Sep 01 12:11:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2b0192b8-be0f-4653-8821-51bddfa33e0e tempest-VolumesActionsTest-1404060246 None] Lock "cinder-1793449d-6802-4fd3-9884-e5357fb8fbbe" released by "attach_volume" :: held 0.171s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:11:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c12cff1d-8aca-4926-b768-e5cec820ec3c tempest-VolumesActionsTest-1404060246 None] Acquiring lock "cinder-1793449d-6802-4fd3-9884-e5357fb8fbbe-detach_volume" by "detach_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:11:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c12cff1d-8aca-4926-b768-e5cec820ec3c tempest-VolumesActionsTest-1404060246 None] Lock "cinder-1793449d-6802-4fd3-9884-e5357fb8fbbe-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:11:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c12cff1d-8aca-4926-b768-e5cec820ec3c tempest-VolumesActionsTest-1404060246 None] Detaching volume 1793449d-6802-4fd3-9884-e5357fb8fbbe from instance 9e118729-ff6c-4588-a06e-d1fb0256676d. Sep 01 12:11:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c12cff1d-8aca-4926-b768-e5cec820ec3c tempest-VolumesActionsTest-1404060246 None] Detach volume completed successfully. Sep 01 12:11:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c12cff1d-8aca-4926-b768-e5cec820ec3c tempest-VolumesActionsTest-1404060246 None] Lock "cinder-1793449d-6802-4fd3-9884-e5357fb8fbbe-detach_volume" released by "detach_volume" :: held 0.163s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Flow 'volume_create_manager' (9fba74d9-f3a1-4019-8076-7409b76c421e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0e39fe-2a58-4f5a-af17-ccd3ad5fb7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0e39fe-2a58-4f5a-af17-ccd3ad5fb7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1349153469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f354e221-f04a-4f3a-a7f9-045b63c71ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d479df5b2b76443a8f30a56bfaf9d0b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:11:40Z,use_quota=True,user_id='0bc692cd6898471ba7947f193b5e45e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c177eb02-acf6-473d-bc4c-08f9cbc1791d),volume_type_id=c177eb02-acf6-473d-bc4c-08f9cbc1791d)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb0536d-052c-43a4-af69-d2982223647d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb0536d-052c-43a4-af69-d2982223647d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f1937e-0726-4744-9a4a-451d65270dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f1937e-0726-4744-9a4a-451d65270dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f354e221-f04a-4f3a-a7f9-045b63c71ea5', 'volume_name': 'volume-f354e221-f04a-4f3a-a7f9-045b63c71ea5', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c29c2d-6eab-4f82-8809-7fc588d6447e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c29c2d-6eab-4f82-8809-7fc588d6447e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8cc6416-744a-4451-b694-fd392180ee5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:40 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Volume f354e221-f04a-4f3a-a7f9-045b63c71ea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f354e221-f04a-4f3a-a7f9-045b63c71ea5', 'volume_size': 1} Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1349153469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f354e221-f04a-4f3a-a7f9-045b63c71ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d479df5b2b76443a8f30a56bfaf9d0b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:11:40Z,use_quota=True,user_id='0bc692cd6898471ba7947f193b5e45e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c177eb02-acf6-473d-bc4c-08f9cbc1791d),volume_type_id=c177eb02-acf6-473d-bc4c-08f9cbc1791d)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Creating volume f354e221-f04a-4f3a-a7f9-045b63c71ea5 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:11:40 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f354e221-f04a-4f3a-a7f9-045b63c71ea5 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:40 devstack sudo[94679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f354e221-f04a-4f3a-a7f9-045b63c71ea5 1073741824 Sep 01 12:11:40 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:40 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f354e221-f04a-4f3a-a7f9-045b63c71ea5 1073741824" returned: 0 in 0.592s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f354e221-f04a-4f3a-a7f9-045b63c71ea5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:41 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f354e221-f04a-4f3a-a7f9-045b63c71ea5 Sep 01 12:11:41 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:41 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f354e221-f04a-4f3a-a7f9-045b63c71ea5" returned: 0 in 0.330s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:11:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8cc6416-744a-4451-b694-fd392180ee5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f354e221-f04a-4f3a-a7f9-045b63c71ea5', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed11531-d424-4b65-9bb5-81eb2b2998cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Volume volume-f354e221-f04a-4f3a-a7f9-045b63c71ea5 (f354e221-f04a-4f3a-a7f9-045b63c71ea5): created successfully Sep 01 12:11:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed11531-d424-4b65-9bb5-81eb2b2998cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Flow 'volume_create_manager' (9fba74d9-f3a1-4019-8076-7409b76c421e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:11:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-495beead-8cff-40ab-8eac-e5d40efe0254 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Created volume successfully. Sep 01 12:11:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:11:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:11:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:11:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:41 devstack sudo[94726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:11:41 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:11:42 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Flow 'volume_create_manager' (a7637581-dcdb-43ca-9504-8d0cb08235f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04fb4dfb-d8f4-4bc6-9753-273d3f812759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.395s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04fb4dfb-d8f4-4bc6-9753-273d3f812759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-574263438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d40c1111-deaf-4519-b68d-61575a1091d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b5588f0ab342dfa3503d842369887a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:11:42Z,use_quota=True,user_id='0a3779d5d4bf4d98bc2c5236cf60848a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83eb17fb-26b5-4293-b695-fe985dbae1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83eb17fb-26b5-4293-b695-fe985dbae1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6151ed47-a849-47d0-b889-b4778ec38e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6151ed47-a849-47d0-b889-b4778ec38e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd40c1111-deaf-4519-b68d-61575a1091d7', 'volume_name': 'volume-d40c1111-deaf-4519-b68d-61575a1091d7', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096d6420-950d-47a6-8091-15f006eb52ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096d6420-950d-47a6-8091-15f006eb52ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52124867-3ee1-4bda-b49e-5ef7a3472f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:42 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Volume d40c1111-deaf-4519-b68d-61575a1091d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d40c1111-deaf-4519-b68d-61575a1091d7', 'volume_size': 1} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-574263438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d40c1111-deaf-4519-b68d-61575a1091d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b5588f0ab342dfa3503d842369887a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:11:42Z,use_quota=True,user_id='0a3779d5d4bf4d98bc2c5236cf60848a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Creating volume d40c1111-deaf-4519-b68d-61575a1091d7 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:11:42 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:11:42 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7 1073741824 Sep 01 12:11:42 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-77f101c0-00fa-464e-86fa-0d641f2e6c93 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-77f101c0-00fa-464e-86fa-0d641f2e6c93 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-77f101c0-00fa-464e-86fa-0d641f2e6c93 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-77f101c0-00fa-464e-86fa-0d641f2e6c93 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-77f101c0-00fa-464e-86fa-0d641f2e6c93 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-77f101c0-00fa-464e-86fa-0d641f2e6c93 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:42 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:11:42 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:42 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7 1073741824" returned: 0 in 0.611s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:43 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7 Sep 01 12:11:43 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:43 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-77f101c0-00fa-464e-86fa-0d641f2e6c93 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.292s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:43 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-77f101c0-00fa-464e-86fa-0d641f2e6c93 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:11:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-77f101c0-00fa-464e-86fa-0d641f2e6c93 tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Retype volume completed successfully. Sep 01 12:11:43 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7" returned: 0 in 0.294s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:11:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52124867-3ee1-4bda-b49e-5ef7a3472f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d40c1111-deaf-4519-b68d-61575a1091d7', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49bfd1bb-ba71-4ee5-9893-4a34f6a7ad62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:43 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Volume volume-d40c1111-deaf-4519-b68d-61575a1091d7 (d40c1111-deaf-4519-b68d-61575a1091d7): created successfully Sep 01 12:11:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49bfd1bb-ba71-4ee5-9893-4a34f6a7ad62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Flow 'volume_create_manager' (a7637581-dcdb-43ca-9504-8d0cb08235f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:11:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-95be101d-f3d5-4d38-b2a7-41118b166325 tempest-VolumesCloneTest-537689052 None] Created volume successfully. Sep 01 12:11:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Acquiring lock "cinder-f354e221-f04a-4f3a-a7f9-045b63c71ea5-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:11:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Lock "cinder-f354e221-f04a-4f3a-a7f9-045b63c71ea5-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:11:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Acquiring lock "cinder-quobyte-f354e221-f04a-4f3a-a7f9-045b63c71ea5" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:11:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Lock "cinder-quobyte-f354e221-f04a-4f3a-a7f9-045b63c71ea5" acquired by "delete_volume" :: waited 0.040s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:11:44 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a8b1f5-8e37-49fb-8270-a61cf730a3d4]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:11:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f354e221-f04a-4f3a-a7f9-045b63c71ea5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:44 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f354e221-f04a-4f3a-a7f9-045b63c71ea5 Sep 01 12:11:44 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:45 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f354e221-f04a-4f3a-a7f9-045b63c71ea5" returned: 0 in 1.094s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f354e221-f04a-4f3a-a7f9-045b63c71ea5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:45 devstack sudo[94817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f354e221-f04a-4f3a-a7f9-045b63c71ea5 Sep 01 12:11:45 devstack sudo[94817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:45 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:11:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Flow 'volume_create_manager' (1d7f7d7d-f6fc-4f1e-8d6a-22bc4410abc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:11:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca7b8b7-a48f-4982-b6eb-447de394fa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca7b8b7-a48f-4982-b6eb-447de394fa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-237991627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdafd0d4-6599-4c62-90f4-6c23eb9abae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b5588f0ab342dfa3503d842369887a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:11:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=d40c1111-deaf-4519-b68d-61575a1091d7,status='creating',terminated_at=None,updated_at=2026-09-01T10:11:46Z,use_quota=True,user_id='0a3779d5d4bf4d98bc2c5236cf60848a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada50f04-1f21-4718-9841-830d7dfc4ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada50f04-1f21-4718-9841-830d7dfc4ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9d55d7-5b68-4772-ae24-45d3802a429a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9d55d7-5b68-4772-ae24-45d3802a429a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bdafd0d4-6599-4c62-90f4-6c23eb9abae9', 'volume_name': 'volume-bdafd0d4-6599-4c62-90f4-6c23eb9abae9', 'volume_size': 2, 'source_volid': 'd40c1111-deaf-4519-b68d-61575a1091d7', 'source_volstatus': 'available'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3ddcc2-50b6-4183-877b-990a99fe327b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3ddcc2-50b6-4183-877b-990a99fe327b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:11:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b698f4-0093-4c66-b648-8a6e6640df92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:11:45 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Volume bdafd0d4-6599-4c62-90f4-6c23eb9abae9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bdafd0d4-6599-4c62-90f4-6c23eb9abae9', 'volume_size': 2, 'source_volid': 'd40c1111-deaf-4519-b68d-61575a1091d7', 'source_volstatus': 'available'} Sep 01 12:11:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:45 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Cloning volume d40c1111-deaf-4519-b68d-61575a1091d7 to volume bdafd0d4-6599-4c62-90f4-6c23eb9abae9 Sep 01 12:11:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Creating offline snapshot 794d436a-4716-4ce5-bf75-21b63bf035a9 of volume d40c1111-deaf-4519-b68d-61575a1091d7 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:11:45 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[29df2b62-abd9-4c76-8833-2a1a430af18c]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:11:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:45 devstack sudo[94817]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f354e221-f04a-4f3a-a7f9-045b63c71ea5" returned: 0 in 0.413s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Lock "cinder-quobyte-f354e221-f04a-4f3a-a7f9-045b63c71ea5" released by "delete_volume" :: held 1.621s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:11:46 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7 Sep 01 12:11:46 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:46 devstack cinder-volume[87084]: WARNING cinder.quota [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:11:46 devstack cinder-volume[87084]: WARNING cinder.quota [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:11:46 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Created reservations ['0b4dbfa0-9428-4cfc-b10d-768ef9e18c27', '5fc8f8a4-e6c0-4f7c-9cff-ef19bb5a00ac', 'da7eab63-9325-44a6-9160-a130b509cdc2', 'e004a92e-54e5-4ac6-a425-c3e91e2ea74c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:11:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:11:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:11:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:46 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:11:46 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:46 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7" returned: 0 in 1.067s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:47 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9 1G Sep 01 12:11:47 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.492s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:47 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:47 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:11:47 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Deleted volume successfully. Sep 01 12:11:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f30d7859-4eb5-43ab-9ec9-32eba7633dcb tempest-VolumeRetypeWithoutMigrationTest-1530427121 None] Lock "cinder-f354e221-f04a-4f3a-a7f9-045b63c71ea5-delete_volume" released by "delete_volume" :: held 3.095s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:11:48 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9 1G" returned: 0 in 1.052s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d40c1111-deaf-4519-b68d-61575a1091d7 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:48 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d40c1111-deaf-4519-b68d-61575a1091d7 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9 Sep 01 12:11:48 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:48 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d40c1111-deaf-4519-b68d-61575a1091d7 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9" returned: 0 in 0.659s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:48 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9 is being set with open permissions: ugo+rw Sep 01 12:11:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:48 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9 Sep 01 12:11:48 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:49 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9" returned: 0 in 0.345s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:49 devstack sudo[94865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.info Sep 01 12:11:49 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:49 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.info" returned: 0 in 0.355s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:49 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.info is being set with open permissions: ugo+rw Sep 01 12:11:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:49 devstack sudo[94868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.info Sep 01 12:11:49 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:49 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.info" returned: 0 in 0.392s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Acquiring lock "cinder-quobyte-bdafd0d4-6599-4c62-90f4-6c23eb9abae9" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:11:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Lock "cinder-quobyte-bdafd0d4-6599-4c62-90f4-6c23eb9abae9" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:11:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] snapshot: 794d436a-4716-4ce5-bf75-21b63bf035a9, volume: bdafd0d4-6599-4c62-90f4-6c23eb9abae9, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:11:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:11:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:11:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:11:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:11:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:11:50 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8daea04-da79-4d8f-be53-397404c4da7a]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:11:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:50 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9 Sep 01 12:11:50 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:50 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9" returned: 0 in 0.483s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d40c1111-deaf-4519-b68d-61575a1091d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:11:50 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[415e83f2-9cd7-430a-86a7-4e52fbc978bb]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:11:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:50 devstack sudo[94880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7 Sep 01 12:11:50 devstack sudo[94880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:51 devstack sudo[94880]: pam_unix(sudo:session): session closed for user root Sep 01 12:11:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7" returned: 0 in 0.737s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:11:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7 {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:11:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:11:51 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Path /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bdafd0d4-6599-4c62-90f4-6c23eb9abae9 not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:11:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bdafd0d4-6599-4c62-90f4-6c23eb9abae9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:11:51 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bdafd0d4-6599-4c62-90f4-6c23eb9abae9 Sep 01 12:11:51 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:11:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aadd6a09-9338-43c6-a130-34193f42d734 tempest-VolumesActionsTest-1404060246 None] Acquiring lock "cinder-1793449d-6802-4fd3-9884-e5357fb8fbbe" by "attach_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:11:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aadd6a09-9338-43c6-a130-34193f42d734 tempest-VolumesActionsTest-1404060246 None] Lock "cinder-1793449d-6802-4fd3-9884-e5357fb8fbbe" acquired by "attach_volume" :: waited 0.075s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:11:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-aadd6a09-9338-43c6-a130-34193f42d734 tempest-VolumesActionsTest-1404060246 None] Attaching volume 1793449d-6802-4fd3-9884-e5357fb8fbbe to instance 52336749-3405-4847-9c79-e774899a746e at mountpoint /dev/vdb on host None. Sep 01 12:11:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-aadd6a09-9338-43c6-a130-34193f42d734 tempest-VolumesActionsTest-1404060246 None] Attach volume completed successfully. Sep 01 12:11:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aadd6a09-9338-43c6-a130-34193f42d734 tempest-VolumesActionsTest-1404060246 None] Lock "cinder-1793449d-6802-4fd3-9884-e5357fb8fbbe" released by "attach_volume" :: held 0.320s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:11:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-70d8ee6e-b72c-4f79-bce2-9cbfd76b7b20 tempest-VolumesActionsTest-1404060246 None] Acquiring lock "cinder-1793449d-6802-4fd3-9884-e5357fb8fbbe-detach_volume" by "detach_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:11:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-70d8ee6e-b72c-4f79-bce2-9cbfd76b7b20 tempest-VolumesActionsTest-1404060246 None] Lock "cinder-1793449d-6802-4fd3-9884-e5357fb8fbbe-detach_volume" acquired by "detach_volume" :: waited 0.081s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:11:58 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-70d8ee6e-b72c-4f79-bce2-9cbfd76b7b20 tempest-VolumesActionsTest-1404060246 None] Detaching volume 1793449d-6802-4fd3-9884-e5357fb8fbbe from instance 52336749-3405-4847-9c79-e774899a746e. Sep 01 12:11:58 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-70d8ee6e-b72c-4f79-bce2-9cbfd76b7b20 tempest-VolumesActionsTest-1404060246 None] Detach volume completed successfully. Sep 01 12:11:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-70d8ee6e-b72c-4f79-bce2-9cbfd76b7b20 tempest-VolumesActionsTest-1404060246 None] Lock "cinder-1793449d-6802-4fd3-9884-e5357fb8fbbe-detach_volume" released by "detach_volume" :: held 0.342s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:12:00 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bdafd0d4-6599-4c62-90f4-6c23eb9abae9" returned: 0 in 9.673s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:00 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7, size 1024.00 MB, duration 9.68 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bdafd0d4-6599-4c62-90f4-6c23eb9abae9 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:12:00 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Converted 1024.00 MB image at 105.81 MB/s Sep 01 12:12:00 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bdafd0d4-6599-4c62-90f4-6c23eb9abae9 is being set with open permissions: ugo+rw Sep 01 12:12:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bdafd0d4-6599-4c62-90f4-6c23eb9abae9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:01 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bdafd0d4-6599-4c62-90f4-6c23eb9abae9 Sep 01 12:12:01 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:01 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bdafd0d4-6599-4c62-90f4-6c23eb9abae9" returned: 0 in 0.464s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Lock "cinder-quobyte-bdafd0d4-6599-4c62-90f4-6c23eb9abae9" released by "_copy_volume_from_snapshot" :: held 11.497s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:12:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Acquiring lock "cinder-quobyte-794d436a-4716-4ce5-bf75-21b63bf035a9" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:12:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Lock "cinder-quobyte-794d436a-4716-4ce5-bf75-21b63bf035a9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:12:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Deleting offline snapshot 794d436a-4716-4ce5-bf75-21b63bf035a9 of volume d40c1111-deaf-4519-b68d-61575a1091d7 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:12:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] snapshot_file for this snap is: volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:12:01 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca2aac1-0995-4662-a8df-b634d64f9aa1]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:01 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9 Sep 01 12:12:01 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:02 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9" returned: 0 in 0.624s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d40c1111-deaf-4519-b68d-61575a1091d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:12:02 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d96791b-7143-4489-ab94-1f48cb77ed5c]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:02 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7 Sep 01 12:12:02 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:02 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7" returned: 0 in 0.631s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:02 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9 Sep 01 12:12:02 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:03 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9" returned: 0 in 0.343s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:03 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9 Sep 01 12:12:03 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:03 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7.794d436a-4716-4ce5-bf75-21b63bf035a9" returned: 0 in 0.315s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Lock "cinder-quobyte-794d436a-4716-4ce5-bf75-21b63bf035a9" released by "_delete_snapshot" :: held 2.038s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:12:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.717s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:12:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b698f4-0093-4c66-b648-8a6e6640df92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdafd0d4-6599-4c62-90f4-6c23eb9abae9', 'volume_size': 2, 'source_volid': 'd40c1111-deaf-4519-b68d-61575a1091d7', 'source_volstatus': 'available'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:12:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7a54a4-71ea-4dc9-97e8-d6784bca27eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:12:03 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Volume volume-bdafd0d4-6599-4c62-90f4-6c23eb9abae9 (bdafd0d4-6599-4c62-90f4-6c23eb9abae9): created successfully Sep 01 12:12:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7a54a4-71ea-4dc9-97e8-d6784bca27eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:12:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Flow 'volume_create_manager' (1d7f7d7d-f6fc-4f1e-8d6a-22bc4410abc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:12:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f47de2c5-c9ce-4a32-a44e-007b5a81128e tempest-VolumesCloneTest-537689052 None] Created volume successfully. Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1725db53-846c-4e45-89b4-8dfe9ce1ffba tempest-VolumesCloneTest-537689052 None] Acquiring lock "cinder-bdafd0d4-6599-4c62-90f4-6c23eb9abae9-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1725db53-846c-4e45-89b4-8dfe9ce1ffba tempest-VolumesCloneTest-537689052 None] Lock "cinder-bdafd0d4-6599-4c62-90f4-6c23eb9abae9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1725db53-846c-4e45-89b4-8dfe9ce1ffba tempest-VolumesCloneTest-537689052 None] Acquiring lock "cinder-quobyte-bdafd0d4-6599-4c62-90f4-6c23eb9abae9" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1725db53-846c-4e45-89b4-8dfe9ce1ffba tempest-VolumesCloneTest-537689052 None] Lock "cinder-quobyte-bdafd0d4-6599-4c62-90f4-6c23eb9abae9" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[23855175-459f-4e9c-ba66-6e4133781f39]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1725db53-846c-4e45-89b4-8dfe9ce1ffba tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bdafd0d4-6599-4c62-90f4-6c23eb9abae9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Flow 'volume_create_manager' (24f9db4f-61f6-4247-ad25-c5c3c78b66da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958a42e9-33c0-4ebc-ac08-8b1899537471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958a42e9-33c0-4ebc-ac08-8b1899537471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-108196101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0592d2a-84e0-4ba8-abf6-63ba9a5068ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e6962224ef4c3786a5be8c686cab29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:12:05Z,use_quota=True,user_id='84bd3bc4bd4e4d8a9f3e1b0c00a9833e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af93a35c-a898-441e-82df-5c2d8ac9bff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af93a35c-a898-441e-82df-5c2d8ac9bff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b33102dc-4509-494f-ab16-f4ff1cb1c30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:12:05 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bdafd0d4-6599-4c62-90f4-6c23eb9abae9 Sep 01 12:12:05 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b33102dc-4509-494f-ab16-f4ff1cb1c30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0592d2a-84e0-4ba8-abf6-63ba9a5068ab', 'volume_name': 'volume-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd1bc609-e1e3-435c-a577-d01781b6cdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd1bc609-e1e3-435c-a577-d01781b6cdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e5bd32-76f2-45de-95c5-1f7f5c1135eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:12:05 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Volume d0592d2a-84e0-4ba8-abf6-63ba9a5068ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab', 'volume_size': 1} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-108196101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0592d2a-84e0-4ba8-abf6-63ba9a5068ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e6962224ef4c3786a5be8c686cab29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:12:05Z,use_quota=True,user_id='84bd3bc4bd4e4d8a9f3e1b0c00a9833e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Creating volume d0592d2a-84e0-4ba8-abf6-63ba9a5068ab {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:12:05 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:05 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab 1073741824 Sep 01 12:12:05 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-647323ed-0204-4780-90ad-dc191a03f65c tempest-VolumesActionsTest-1404060246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:12:05 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1725db53-846c-4e45-89b4-8dfe9ce1ffba tempest-VolumesCloneTest-537689052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bdafd0d4-6599-4c62-90f4-6c23eb9abae9" returned: 0 in 0.411s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1725db53-846c-4e45-89b4-8dfe9ce1ffba tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bdafd0d4-6599-4c62-90f4-6c23eb9abae9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:05 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bdafd0d4-6599-4c62-90f4-6c23eb9abae9 Sep 01 12:12:05 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:05 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab 1073741824" returned: 0 in 0.455s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=75,cinder:UPDATE=79,cinder:DELETE=5,cinder:INSERT=16 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:06 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1725db53-846c-4e45-89b4-8dfe9ce1ffba tempest-VolumesCloneTest-537689052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bdafd0d4-6599-4c62-90f4-6c23eb9abae9" returned: 0 in 0.264s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:06 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab Sep 01 12:12:06 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1725db53-846c-4e45-89b4-8dfe9ce1ffba tempest-VolumesCloneTest-537689052 None] Lock "cinder-quobyte-bdafd0d4-6599-4c62-90f4-6c23eb9abae9" released by "delete_volume" :: held 0.726s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:INSERT=22,cinder:UPDATE=77,cinder:SELECT=70,cinder:DELETE=4 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-1725db53-846c-4e45-89b4-8dfe9ce1ffba tempest-VolumesCloneTest-537689052 None] Created reservations ['c595d4f3-90e7-4dab-92a9-35c6b139c55e', 'e915f974-f531-4504-9e86-131367e88e49', 'a5d9e06b-75dd-4f1f-9f01-3adc1e86d867', 'f6992330-5c02-43cb-a8c3-ae9e80b73f4d'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1725db53-846c-4e45-89b4-8dfe9ce1ffba tempest-VolumesCloneTest-537689052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1725db53-846c-4e45-89b4-8dfe9ce1ffba tempest-VolumesCloneTest-537689052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1725db53-846c-4e45-89b4-8dfe9ce1ffba tempest-VolumesCloneTest-537689052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1725db53-846c-4e45-89b4-8dfe9ce1ffba tempest-VolumesCloneTest-537689052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1725db53-846c-4e45-89b4-8dfe9ce1ffba tempest-VolumesCloneTest-537689052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1725db53-846c-4e45-89b4-8dfe9ce1ffba tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:06 devstack sudo[95044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:12:06 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:06 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab" returned: 0 in 0.245s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-647323ed-0204-4780-90ad-dc191a03f65c tempest-VolumesActionsTest-1404060246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.680s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e5bd32-76f2-45de-95c5-1f7f5c1135eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27266e2-a7a1-4257-aecc-09674ce3fe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[393122cd-502f-4c66-a1b2-2cd8650b4e74]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-647323ed-0204-4780-90ad-dc191a03f65c tempest-VolumesActionsTest-1404060246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:06 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Volume volume-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab (d0592d2a-84e0-4ba8-abf6-63ba9a5068ab): created successfully Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27266e2-a7a1-4257-aecc-09674ce3fe04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Flow 'volume_create_manager' (24f9db4f-61f6-4247-ad25-c5c3c78b66da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:12:06 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-399e77f6-7086-4446-ba12-6e7e10f483b3 tempest-AbsoluteLimitsTests-253328988 None] Created volume successfully. Sep 01 12:12:06 devstack sudo[95047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe Sep 01 12:12:06 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:06 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1725db53-846c-4e45-89b4-8dfe9ce1ffba tempest-VolumesCloneTest-537689052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.292s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-1725db53-846c-4e45-89b4-8dfe9ce1ffba tempest-VolumesCloneTest-537689052 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:12:06 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1725db53-846c-4e45-89b4-8dfe9ce1ffba tempest-VolumesCloneTest-537689052 None] Deleted volume successfully. Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1725db53-846c-4e45-89b4-8dfe9ce1ffba tempest-VolumesCloneTest-537689052 None] Lock "cinder-bdafd0d4-6599-4c62-90f4-6c23eb9abae9-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d95874a6-0b66-49a6-a47a-93957a47f322 tempest-VolumesCloneTest-537689052 None] Acquiring lock "cinder-d40c1111-deaf-4519-b68d-61575a1091d7-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d95874a6-0b66-49a6-a47a-93957a47f322 tempest-VolumesCloneTest-537689052 None] Lock "cinder-d40c1111-deaf-4519-b68d-61575a1091d7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-43f44464-add2-433a-bc72-009015f47616 tempest-AbsoluteLimitsTests-253328988 None] Acquiring lock "cinder-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d95874a6-0b66-49a6-a47a-93957a47f322 tempest-VolumesCloneTest-537689052 None] Acquiring lock "cinder-quobyte-d40c1111-deaf-4519-b68d-61575a1091d7" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-43f44464-add2-433a-bc72-009015f47616 tempest-AbsoluteLimitsTests-253328988 None] Lock "cinder-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d95874a6-0b66-49a6-a47a-93957a47f322 tempest-VolumesCloneTest-537689052 None] Lock "cinder-quobyte-d40c1111-deaf-4519-b68d-61575a1091d7" acquired by "delete_volume" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:12:06 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-647323ed-0204-4780-90ad-dc191a03f65c tempest-VolumesActionsTest-1404060246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe" returned: 0 in 0.453s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3752b9b1-7aaa-4bb5-bdef-dbabef433d03]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d95874a6-0b66-49a6-a47a-93957a47f322 tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2896a73-ed8f-4029-890b-4359e6557786]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-647323ed-0204-4780-90ad-dc191a03f65c tempest-VolumesActionsTest-1404060246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-43f44464-add2-433a-bc72-009015f47616 tempest-AbsoluteLimitsTests-253328988 None] Acquiring lock "cinder-quobyte-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-43f44464-add2-433a-bc72-009015f47616 tempest-AbsoluteLimitsTests-253328988 None] Lock "cinder-quobyte-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfd86f5-2392-4cb4-a621-af1aba8e08f8]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43f44464-add2-433a-bc72-009015f47616 tempest-AbsoluteLimitsTests-253328988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:06 devstack sudo[95054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7 Sep 01 12:12:06 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:06 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe Sep 01 12:12:06 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:06 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab Sep 01 12:12:06 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:07 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d95874a6-0b66-49a6-a47a-93957a47f322 tempest-VolumesCloneTest-537689052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7" returned: 0 in 0.388s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d95874a6-0b66-49a6-a47a-93957a47f322 tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:07 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-647323ed-0204-4780-90ad-dc191a03f65c tempest-VolumesActionsTest-1404060246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe" returned: 0 in 0.403s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:07 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7 Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-647323ed-0204-4780-90ad-dc191a03f65c tempest-VolumesActionsTest-1404060246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe /opt/stack/data/cinder/conversion/1793449d-6802-4fd3-9884-e5357fb8fbbe.temp_image.29c6207c-69a5-44a7-9a9e-52a4f26dcc6ernn44i59.img {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:07 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:07 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe /opt/stack/data/cinder/conversion/1793449d-6802-4fd3-9884-e5357fb8fbbe.temp_image.29c6207c-69a5-44a7-9a9e-52a4f26dcc6ernn44i59.img Sep 01 12:12:07 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:07 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43f44464-add2-433a-bc72-009015f47616 tempest-AbsoluteLimitsTests-253328988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab" returned: 0 in 0.385s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43f44464-add2-433a-bc72-009015f47616 tempest-AbsoluteLimitsTests-253328988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:07 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab Sep 01 12:12:07 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:07 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d95874a6-0b66-49a6-a47a-93957a47f322 tempest-VolumesCloneTest-537689052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d40c1111-deaf-4519-b68d-61575a1091d7" returned: 0 in 0.303s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d95874a6-0b66-49a6-a47a-93957a47f322 tempest-VolumesCloneTest-537689052 None] Lock "cinder-quobyte-d40c1111-deaf-4519-b68d-61575a1091d7" released by "delete_volume" :: held 0.765s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:12:07 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43f44464-add2-433a-bc72-009015f47616 tempest-AbsoluteLimitsTests-253328988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab" returned: 0 in 0.321s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-d95874a6-0b66-49a6-a47a-93957a47f322 tempest-VolumesCloneTest-537689052 None] Created reservations ['e64c2a2f-96b3-4e38-9f89-48ee4482a8e7', '76f7bc18-49bf-40a0-a970-6fd84983fd69', 'b97b941a-d270-405d-aece-33988d942ea7', 'be535686-ff82-43b6-9764-9d6b05109e99'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-43f44464-add2-433a-bc72-009015f47616 tempest-AbsoluteLimitsTests-253328988 None] Lock "cinder-quobyte-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab" released by "delete_volume" :: held 0.785s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-43f44464-add2-433a-bc72-009015f47616 tempest-AbsoluteLimitsTests-253328988 None] Created reservations ['29a8717a-bce8-4a14-84fa-03c57ced080a', '99d695d7-bc98-4339-bf29-fe2b22d95d3c', 'eb26e674-57d9-402e-81b3-649c3eaef123', 'dba13c9f-1178-48f7-b985-3647469bcda9'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d95874a6-0b66-49a6-a47a-93957a47f322 tempest-VolumesCloneTest-537689052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d95874a6-0b66-49a6-a47a-93957a47f322 tempest-VolumesCloneTest-537689052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d95874a6-0b66-49a6-a47a-93957a47f322 tempest-VolumesCloneTest-537689052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d95874a6-0b66-49a6-a47a-93957a47f322 tempest-VolumesCloneTest-537689052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d95874a6-0b66-49a6-a47a-93957a47f322 tempest-VolumesCloneTest-537689052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d95874a6-0b66-49a6-a47a-93957a47f322 tempest-VolumesCloneTest-537689052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:07 devstack sudo[95088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:12:07 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-43f44464-add2-433a-bc72-009015f47616 tempest-AbsoluteLimitsTests-253328988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-43f44464-add2-433a-bc72-009015f47616 tempest-AbsoluteLimitsTests-253328988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-43f44464-add2-433a-bc72-009015f47616 tempest-AbsoluteLimitsTests-253328988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-43f44464-add2-433a-bc72-009015f47616 tempest-AbsoluteLimitsTests-253328988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-43f44464-add2-433a-bc72-009015f47616 tempest-AbsoluteLimitsTests-253328988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:12:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43f44464-add2-433a-bc72-009015f47616 tempest-AbsoluteLimitsTests-253328988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:08 devstack sudo[95090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:12:08 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:08 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d95874a6-0b66-49a6-a47a-93957a47f322 tempest-VolumesCloneTest-537689052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.787s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:08 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-d95874a6-0b66-49a6-a47a-93957a47f322 tempest-VolumesCloneTest-537689052 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:12:08 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d95874a6-0b66-49a6-a47a-93957a47f322 tempest-VolumesCloneTest-537689052 None] Deleted volume successfully. Sep 01 12:12:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d95874a6-0b66-49a6-a47a-93957a47f322 tempest-VolumesCloneTest-537689052 None] Lock "cinder-d40c1111-deaf-4519-b68d-61575a1091d7-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:12:08 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43f44464-add2-433a-bc72-009015f47616 tempest-AbsoluteLimitsTests-253328988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.847s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:08 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-43f44464-add2-433a-bc72-009015f47616 tempest-AbsoluteLimitsTests-253328988 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:12:08 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-43f44464-add2-433a-bc72-009015f47616 tempest-AbsoluteLimitsTests-253328988 None] Deleted volume successfully. Sep 01 12:12:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-43f44464-add2-433a-bc72-009015f47616 tempest-AbsoluteLimitsTests-253328988 None] Lock "cinder-d0592d2a-84e0-4ba8-abf6-63ba9a5068ab-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:12:13 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-647323ed-0204-4780-90ad-dc191a03f65c tempest-VolumesActionsTest-1404060246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe /opt/stack/data/cinder/conversion/1793449d-6802-4fd3-9884-e5357fb8fbbe.temp_image.29c6207c-69a5-44a7-9a9e-52a4f26dcc6ernn44i59.img" returned: 0 in 6.311s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:13 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[996f84ca-0ce6-4e02-9f6f-baf16c654a27]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-647323ed-0204-4780-90ad-dc191a03f65c tempest-VolumesActionsTest-1404060246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:13 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe Sep 01 12:12:13 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:14 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-647323ed-0204-4780-90ad-dc191a03f65c tempest-VolumesActionsTest-1404060246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe" returned: 0 in 0.764s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:14 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-647323ed-0204-4780-90ad-dc191a03f65c tempest-VolumesActionsTest-1404060246 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe, size 1024.00 MB, duration 6.31 sec, destination /opt/stack/data/cinder/conversion/1793449d-6802-4fd3-9884-e5357fb8fbbe.temp_image.29c6207c-69a5-44a7-9a9e-52a4f26dcc6ernn44i59.img {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:12:14 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-647323ed-0204-4780-90ad-dc191a03f65c tempest-VolumesActionsTest-1404060246 None] Converted 1024.00 MB image at 162.23 MB/s Sep 01 12:12:14 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-647323ed-0204-4780-90ad-dc191a03f65c tempest-VolumesActionsTest-1404060246 None] 29c6207c-69a5-44a7-9a9e-52a4f26dcc6e was raw, no need to convert to raw {{(pid=87084) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 12:12:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c4ade838-b479-497c-91e6-b280b997ea26 tempest-AttachVolumeShelveTestJSON-2116667393 None] Acquiring lock "cinder-ecd47cfa-25d9-4faa-8a78-ddca0884c735-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:12:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c4ade838-b479-497c-91e6-b280b997ea26 tempest-AttachVolumeShelveTestJSON-2116667393 None] Lock "cinder-ecd47cfa-25d9-4faa-8a78-ddca0884c735-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:12:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c4ade838-b479-497c-91e6-b280b997ea26 tempest-AttachVolumeShelveTestJSON-2116667393 None] Acquiring lock "cinder-quobyte-ecd47cfa-25d9-4faa-8a78-ddca0884c735" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:12:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c4ade838-b479-497c-91e6-b280b997ea26 tempest-AttachVolumeShelveTestJSON-2116667393 None] Lock "cinder-quobyte-ecd47cfa-25d9-4faa-8a78-ddca0884c735" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:12:17 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b874755-fb38-473b-904d-4ee2de43f081]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c4ade838-b479-497c-91e6-b280b997ea26 tempest-AttachVolumeShelveTestJSON-2116667393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd47cfa-25d9-4faa-8a78-ddca0884c735 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:17 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd47cfa-25d9-4faa-8a78-ddca0884c735 Sep 01 12:12:17 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:17 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c4ade838-b479-497c-91e6-b280b997ea26 tempest-AttachVolumeShelveTestJSON-2116667393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd47cfa-25d9-4faa-8a78-ddca0884c735" returned: 0 in 0.560s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c4ade838-b479-497c-91e6-b280b997ea26 tempest-AttachVolumeShelveTestJSON-2116667393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd47cfa-25d9-4faa-8a78-ddca0884c735 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:17 devstack sudo[95136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd47cfa-25d9-4faa-8a78-ddca0884c735 Sep 01 12:12:17 devstack sudo[95136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:17 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:12:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Flow 'volume_create_manager' (98a9815f-e71b-46c5-8d40-a25aa757f4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:12:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0545ac8-18ed-447f-a985-64aaddd1e869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:12:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0545ac8-18ed-447f-a985-64aaddd1e869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-197825444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e39e97f-8c08-4c61-9d78-9b433621ed2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dceb145acad4c47be1ee19c4415f6fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:12:18Z,use_quota=True,user_id='ed1106f9c63a4cf4b2c1e0baabf9f62c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:12:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4669bfb7-c245-4743-b059-3572e0c73f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:12:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4669bfb7-c245-4743-b059-3572e0c73f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:12:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50e5d04-3c0b-47e3-8c8b-3e4152f3e4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:12:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50e5d04-3c0b-47e3-8c8b-3e4152f3e4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e39e97f-8c08-4c61-9d78-9b433621ed2d', 'volume_name': 'volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:12:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9f521c-7a74-45fc-8a44-3125b0c21d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:12:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9f521c-7a74-45fc-8a44-3125b0c21d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:12:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa935cc-bb94-476a-98e0-651ba218c29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:12:18 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Volume 9e39e97f-8c08-4c61-9d78-9b433621ed2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d', 'volume_size': 1} Sep 01 12:12:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:12:18 devstack sudo[95136]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c4ade838-b479-497c-91e6-b280b997ea26 tempest-AttachVolumeShelveTestJSON-2116667393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd47cfa-25d9-4faa-8a78-ddca0884c735" returned: 0 in 0.315s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c4ade838-b479-497c-91e6-b280b997ea26 tempest-AttachVolumeShelveTestJSON-2116667393 None] Lock "cinder-quobyte-ecd47cfa-25d9-4faa-8a78-ddca0884c735" released by "delete_volume" :: held 0.958s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:12:18 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c4ade838-b479-497c-91e6-b280b997ea26 tempest-AttachVolumeShelveTestJSON-2116667393 None] Created reservations ['6b5be3a5-e3de-40fa-a407-90f1403b89ad', '9a2c1559-4c8b-4dc8-aba9-78d0313b8152', '9d6e1dac-7b15-4b3b-be72-836a69ebdd5b', 'd325abc6-40fd-4333-8ba4-b67e5b545cdd'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:12:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c4ade838-b479-497c-91e6-b280b997ea26 tempest-AttachVolumeShelveTestJSON-2116667393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:12:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c4ade838-b479-497c-91e6-b280b997ea26 tempest-AttachVolumeShelveTestJSON-2116667393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:12:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c4ade838-b479-497c-91e6-b280b997ea26 tempest-AttachVolumeShelveTestJSON-2116667393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:12:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c4ade838-b479-497c-91e6-b280b997ea26 tempest-AttachVolumeShelveTestJSON-2116667393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:12:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c4ade838-b479-497c-91e6-b280b997ea26 tempest-AttachVolumeShelveTestJSON-2116667393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:12:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c4ade838-b479-497c-91e6-b280b997ea26 tempest-AttachVolumeShelveTestJSON-2116667393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:18 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:12:18 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:18 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c4ade838-b479-497c-91e6-b280b997ea26 tempest-AttachVolumeShelveTestJSON-2116667393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.324s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:18 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c4ade838-b479-497c-91e6-b280b997ea26 tempest-AttachVolumeShelveTestJSON-2116667393 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:12:18 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c4ade838-b479-497c-91e6-b280b997ea26 tempest-AttachVolumeShelveTestJSON-2116667393 None] Deleted volume successfully. Sep 01 12:12:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c4ade838-b479-497c-91e6-b280b997ea26 tempest-AttachVolumeShelveTestJSON-2116667393 None] Lock "cinder-ecd47cfa-25d9-4faa-8a78-ddca0884c735-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:12:19 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:12:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Flow 'volume_create_manager' (b5efe9ca-b817-4326-8ffb-52ca5c9f2aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:12:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7eb510-5301-4fa2-8bf5-4cbddd0d2e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:12:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7eb510-5301-4fa2-8bf5-4cbddd0d2e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1458524987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1233b117-877c-45dd-b9f9-0f0ae81a91d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d31a5bdcf1594b1495383db26e8dc048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:12:19Z,use_quota=True,user_id='4f7cdd2e851744f2a41903a42d7d8c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:12:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7cf14c-0eb9-4ed8-b231-c188e5d5c101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:12:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7cf14c-0eb9-4ed8-b231-c188e5d5c101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:12:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (065cfb32-8ec2-4c0f-b287-9f86d1c38b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:12:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (065cfb32-8ec2-4c0f-b287-9f86d1c38b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1233b117-877c-45dd-b9f9-0f0ae81a91d5', 'volume_name': 'volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:12:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (270585d5-34af-449d-ba49-6c778d4fdd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:12:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (270585d5-34af-449d-ba49-6c778d4fdd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:12:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09bebdee-8f63-4630-8066-24b3432cc842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:12:19 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Volume 1233b117-877c-45dd-b9f9-0f0ae81a91d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5', 'volume_size': 1} Sep 01 12:12:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:12:29 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=19,cinder:INSERT=9,cinder:UPDATE=38,cinder:DELETE=4 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:12:29 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=24,cinder:INSERT=7,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:12:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-647323ed-0204-4780-90ad-dc191a03f65c tempest-VolumesActionsTest-1404060246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.196s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:12:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-647323ed-0204-4780-90ad-dc191a03f65c tempest-VolumesActionsTest-1404060246 None] Uploaded volume to glance image-id: 29c6207c-69a5-44a7-9a9e-52a4f26dcc6e. {{(pid=87084) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 12:12:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.424s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:12:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-197825444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e39e97f-8c08-4c61-9d78-9b433621ed2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dceb145acad4c47be1ee19c4415f6fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:12:18Z,use_quota=True,user_id='ed1106f9c63a4cf4b2c1e0baabf9f62c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:12:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Creating volume 9e39e97f-8c08-4c61-9d78-9b433621ed2d {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:12:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:12:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:12:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:12:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:12:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:12:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:12:37 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:12:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:37 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d 1073741824 Sep 01 12:12:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-647323ed-0204-4780-90ad-dc191a03f65c tempest-VolumesActionsTest-1404060246 None] Copy volume to image completed successfully. Sep 01 12:12:37 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:37 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d 1073741824" returned: 0 in 0.438s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:37 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d Sep 01 12:12:37 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:38 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d" returned: 0 in 0.255s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:12:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:12:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.769s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:12:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1458524987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1233b117-877c-45dd-b9f9-0f0ae81a91d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d31a5bdcf1594b1495383db26e8dc048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:12:19Z,use_quota=True,user_id='4f7cdd2e851744f2a41903a42d7d8c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:12:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Creating volume 1233b117-877c-45dd-b9f9-0f0ae81a91d5 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:12:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:12:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:12:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:12:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:12:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:12:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:12:38 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:12:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa935cc-bb94-476a-98e0-651ba218c29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:12:38 devstack sudo[95197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5 1073741824 Sep 01 12:12:38 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2404d1df-4e10-4815-bd28-367d3005450f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:12:38 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Volume volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d (9e39e97f-8c08-4c61-9d78-9b433621ed2d): created successfully Sep 01 12:12:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2404d1df-4e10-4815-bd28-367d3005450f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:12:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Flow 'volume_create_manager' (98a9815f-e71b-46c5-8d40-a25aa757f4c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:12:38 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2fca791c-aef6-44ed-a48f-8a68ab2379df tempest-VolumesDeleteCascade-1130917395 None] Created volume successfully. Sep 01 12:12:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-02e2cdca-6bbc-46f0-912f-cba23c066d82 tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:12:38 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5 1073741824" returned: 0 in 0.587s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:38 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5 Sep 01 12:12:38 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:39 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5" returned: 0 in 0.281s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:12:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:12:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-02e2cdca-6bbc-46f0-912f-cba23c066d82 tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.386s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:12:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09bebdee-8f63-4630-8066-24b3432cc842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:12:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b8f7da9-4b00-4b70-8053-00b6ad060977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:12:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-02e2cdca-6bbc-46f0-912f-cba23c066d82 tempest-VolumesDeleteCascade-1130917395 None] Creating offline snapshot 1a315f59-df53-4031-b967-b7dff4d74d02 of volume 9e39e97f-8c08-4c61-9d78-9b433621ed2d {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:12:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Volume volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5 (1233b117-877c-45dd-b9f9-0f0ae81a91d5): created successfully Sep 01 12:12:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b8f7da9-4b00-4b70-8053-00b6ad060977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:12:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Flow 'volume_create_manager' (b5efe9ca-b817-4326-8ffb-52ca5c9f2aae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:12:39 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d368f82-cd59-4607-bc40-f5ae832e7e3d]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-02e2cdca-6bbc-46f0-912f-cba23c066d82 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:39 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-159632ef-42c1-4829-8cda-493f14dc0cb9 tempest-VolumesSnapshotListTestJSON-1921258441 None] Created volume successfully. Sep 01 12:12:39 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d Sep 01 12:12:39 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:12:39 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-02e2cdca-6bbc-46f0-912f-cba23c066d82 tempest-VolumesDeleteCascade-1130917395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d" returned: 0 in 0.439s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-02e2cdca-6bbc-46f0-912f-cba23c066d82 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:39 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 1G Sep 01 12:12:39 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:40 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-02e2cdca-6bbc-46f0-912f-cba23c066d82 tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 1G" returned: 0 in 0.468s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-02e2cdca-6bbc-46f0-912f-cba23c066d82 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:40 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 Sep 01 12:12:40 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1bb1fa27-4036-40da-8f23-4bb3bde4313a tempest-VolumesSnapshotListTestJSON-1921258441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:12:40 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-02e2cdca-6bbc-46f0-912f-cba23c066d82 tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02" returned: 0 in 0.316s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:40 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-02e2cdca-6bbc-46f0-912f-cba23c066d82 tempest-VolumesDeleteCascade-1130917395 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 is being set with open permissions: ugo+rw Sep 01 12:12:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-02e2cdca-6bbc-46f0-912f-cba23c066d82 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:40 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 Sep 01 12:12:40 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:40 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-02e2cdca-6bbc-46f0-912f-cba23c066d82 tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02" returned: 0 in 0.238s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-02e2cdca-6bbc-46f0-912f-cba23c066d82 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:40 devstack sudo[95223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.info Sep 01 12:12:40 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:40 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-02e2cdca-6bbc-46f0-912f-cba23c066d82 tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.info" returned: 0 in 0.249s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:40 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-02e2cdca-6bbc-46f0-912f-cba23c066d82 tempest-VolumesDeleteCascade-1130917395 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.info is being set with open permissions: ugo+rw Sep 01 12:12:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-02e2cdca-6bbc-46f0-912f-cba23c066d82 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:41 devstack sudo[95226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.info Sep 01 12:12:41 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:41 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-02e2cdca-6bbc-46f0-912f-cba23c066d82 tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.info" returned: 0 in 0.282s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-02e2cdca-6bbc-46f0-912f-cba23c066d82 tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.119s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:12:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.641s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:12:41 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cac835b-9408-442c-b1aa-df7b434977e7]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-02e2cdca-6bbc-46f0-912f-cba23c066d82 tempest-VolumesDeleteCascade-1130917395 None] Create snapshot completed successfully Sep 01 12:12:41 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe Sep 01 12:12:41 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:41 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe" returned: 0 in 0.376s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:41 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f732cf1f-df4b-42a7-b0ee-21fa6a1db546]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:12:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:12:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:12:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:12:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:12:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:12:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:41 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe Sep 01 12:12:41 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:41 devstack sudo[95238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:12:41 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:42 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.291s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:12:42 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:12:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:12:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:12:42 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe" returned: 0 in 0.467s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe /opt/stack/data/cinder/conversion/1793449d-6802-4fd3-9884-e5357fb8fbbe.temp_image.588d27b6-e31c-43a6-b48e-5538e2807fb5nbjoj46j.img {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:42 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe /opt/stack/data/cinder/conversion/1793449d-6802-4fd3-9884-e5357fb8fbbe.temp_image.588d27b6-e31c-43a6-b48e-5538e2807fb5nbjoj46j.img Sep 01 12:12:42 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-93f661f0-695a-44a3-9553-77b199f67d62 tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:12:47 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe /opt/stack/data/cinder/conversion/1793449d-6802-4fd3-9884-e5357fb8fbbe.temp_image.588d27b6-e31c-43a6-b48e-5538e2807fb5nbjoj46j.img" returned: 0 in 5.125s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:47 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[993e2658-8f90-41af-8f2b-a9d30475458b]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:47 devstack sudo[95277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe Sep 01 12:12:47 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:48 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe" returned: 0 in 0.730s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:48 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe, size 1024.00 MB, duration 5.13 sec, destination /opt/stack/data/cinder/conversion/1793449d-6802-4fd3-9884-e5357fb8fbbe.temp_image.588d27b6-e31c-43a6-b48e-5538e2807fb5nbjoj46j.img {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:12:48 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] Converted 1024.00 MB image at 199.75 MB/s Sep 01 12:12:48 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] 588d27b6-e31c-43a6-b48e-5538e2807fb5 was raw, converting to qcow2 {{(pid=87084) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 01 12:12:48 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[237c5512-cb80-471b-a320-be72487c9742]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1793449d-6802-4fd3-9884-e5357fb8fbbe.temp_image.588d27b6-e31c-43a6-b48e-5538e2807fb5nbjoj46j.img {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:48 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1793449d-6802-4fd3-9884-e5357fb8fbbe.temp_image.588d27b6-e31c-43a6-b48e-5538e2807fb5nbjoj46j.img Sep 01 12:12:48 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:48 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1793449d-6802-4fd3-9884-e5357fb8fbbe.temp_image.588d27b6-e31c-43a6-b48e-5538e2807fb5nbjoj46j.img" returned: 0 in 0.699s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1793449d-6802-4fd3-9884-e5357fb8fbbe.temp_image.588d27b6-e31c-43a6-b48e-5538e2807fb5nbjoj46j.img {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:48 devstack sudo[95349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1793449d-6802-4fd3-9884-e5357fb8fbbe.temp_image.588d27b6-e31c-43a6-b48e-5538e2807fb5nbjoj46j.img Sep 01 12:12:48 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:49 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1793449d-6802-4fd3-9884-e5357fb8fbbe.temp_image.588d27b6-e31c-43a6-b48e-5538e2807fb5nbjoj46j.img" returned: 1 in 0.413s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1793449d-6802-4fd3-9884-e5357fb8fbbe.temp_image.588d27b6-e31c-43a6-b48e-5538e2807fb5nbjoj46j.img' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:12:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1793449d-6802-4fd3-9884-e5357fb8fbbe.temp_image.588d27b6-e31c-43a6-b48e-5538e2807fb5nbjoj46j.img /opt/stack/data/cinder/conversion/vol_upload_3l0w3dxx {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:49 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1793449d-6802-4fd3-9884-e5357fb8fbbe.temp_image.588d27b6-e31c-43a6-b48e-5538e2807fb5nbjoj46j.img /opt/stack/data/cinder/conversion/vol_upload_3l0w3dxx Sep 01 12:12:49 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:49 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1793449d-6802-4fd3-9884-e5357fb8fbbe.temp_image.588d27b6-e31c-43a6-b48e-5538e2807fb5nbjoj46j.img /opt/stack/data/cinder/conversion/vol_upload_3l0w3dxx" returned: 0 in 0.349s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:49 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] Image conversion details: src /opt/stack/data/cinder/conversion/1793449d-6802-4fd3-9884-e5357fb8fbbe.temp_image.588d27b6-e31c-43a6-b48e-5538e2807fb5nbjoj46j.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_3l0w3dxx {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:12:49 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 01 12:12:49 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0cdb56-d6c9-4869-bef0-4784d172ec25]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3l0w3dxx {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:49 devstack sudo[95365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3l0w3dxx Sep 01 12:12:49 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:49 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3l0w3dxx" returned: 0 in 0.391s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.266s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:12:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] Uploaded volume to glance image-id: 588d27b6-e31c-43a6-b48e-5538e2807fb5. {{(pid=87084) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 12:12:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1bb1fa27-4036-40da-8f23-4bb3bde4313a tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.378s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:12:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-1bb1fa27-4036-40da-8f23-4bb3bde4313a tempest-VolumesSnapshotListTestJSON-1921258441 None] Creating offline snapshot 548e4ff8-b6f2-4aab-a3f8-7b51920a94be of volume 1233b117-877c-45dd-b9f9-0f0ae81a91d5 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:12:51 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-024e2c6f-81c7-4673-ab46-b3c85faeed97 tempest-VolumesActionsTest-1404060246 None] Copy volume to image completed successfully. Sep 01 12:12:51 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[373f01f5-b395-475e-9b3d-1f324bcedb25]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1bb1fa27-4036-40da-8f23-4bb3bde4313a tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:51 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5 Sep 01 12:12:51 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:52 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1bb1fa27-4036-40da-8f23-4bb3bde4313a tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5" returned: 0 in 0.435s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1bb1fa27-4036-40da-8f23-4bb3bde4313a tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:52 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be 1G Sep 01 12:12:52 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:52 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1bb1fa27-4036-40da-8f23-4bb3bde4313a tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be 1G" returned: 0 in 0.568s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1bb1fa27-4036-40da-8f23-4bb3bde4313a tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:52 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be Sep 01 12:12:52 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:53 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1bb1fa27-4036-40da-8f23-4bb3bde4313a tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be" returned: 0 in 0.412s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:53 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-1bb1fa27-4036-40da-8f23-4bb3bde4313a tempest-VolumesSnapshotListTestJSON-1921258441 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be is being set with open permissions: ugo+rw Sep 01 12:12:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1bb1fa27-4036-40da-8f23-4bb3bde4313a tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:53 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be Sep 01 12:12:53 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2bc948f8-2ad5-461d-acc7-83bd9fa2beac tempest-VolumesActionsTest-1404060246 None] Acquiring lock "cinder-1793449d-6802-4fd3-9884-e5357fb8fbbe-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:12:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2bc948f8-2ad5-461d-acc7-83bd9fa2beac tempest-VolumesActionsTest-1404060246 None] Lock "cinder-1793449d-6802-4fd3-9884-e5357fb8fbbe-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:12:53 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1bb1fa27-4036-40da-8f23-4bb3bde4313a tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be" returned: 0 in 0.434s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2bc948f8-2ad5-461d-acc7-83bd9fa2beac tempest-VolumesActionsTest-1404060246 None] Acquiring lock "cinder-quobyte-1793449d-6802-4fd3-9884-e5357fb8fbbe" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:12:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2bc948f8-2ad5-461d-acc7-83bd9fa2beac tempest-VolumesActionsTest-1404060246 None] Lock "cinder-quobyte-1793449d-6802-4fd3-9884-e5357fb8fbbe" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:12:53 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d884ba-6085-42d6-bf0d-761c67757311]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2bc948f8-2ad5-461d-acc7-83bd9fa2beac tempest-VolumesActionsTest-1404060246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1bb1fa27-4036-40da-8f23-4bb3bde4313a tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:53 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.info Sep 01 12:12:53 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:53 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe Sep 01 12:12:53 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:53 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1bb1fa27-4036-40da-8f23-4bb3bde4313a tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.info" returned: 0 in 0.358s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:53 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-1bb1fa27-4036-40da-8f23-4bb3bde4313a tempest-VolumesSnapshotListTestJSON-1921258441 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.info is being set with open permissions: ugo+rw Sep 01 12:12:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1bb1fa27-4036-40da-8f23-4bb3bde4313a tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:53 devstack sudo[95401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.info Sep 01 12:12:53 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:53 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2bc948f8-2ad5-461d-acc7-83bd9fa2beac tempest-VolumesActionsTest-1404060246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe" returned: 0 in 0.464s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2bc948f8-2ad5-461d-acc7-83bd9fa2beac tempest-VolumesActionsTest-1404060246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:54 devstack sudo[95404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe Sep 01 12:12:54 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:54 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1bb1fa27-4036-40da-8f23-4bb3bde4313a tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.info" returned: 0 in 0.282s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1bb1fa27-4036-40da-8f23-4bb3bde4313a tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.650s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:12:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-93f661f0-695a-44a3-9553-77b199f67d62 tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.956s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:12:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-93f661f0-695a-44a3-9553-77b199f67d62 tempest-VolumesDeleteCascade-1130917395 None] Creating offline snapshot 30cc9d72-581b-4d56-b5f8-5a506189ac0a of volume 9e39e97f-8c08-4c61-9d78-9b433621ed2d {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:12:54 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2bc948f8-2ad5-461d-acc7-83bd9fa2beac tempest-VolumesActionsTest-1404060246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1793449d-6802-4fd3-9884-e5357fb8fbbe" returned: 0 in 0.282s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:54 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[49df9147-e1e3-42ef-8f87-b20ab4fa1c6e]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-93f661f0-695a-44a3-9553-77b199f67d62 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2bc948f8-2ad5-461d-acc7-83bd9fa2beac tempest-VolumesActionsTest-1404060246 None] Lock "cinder-quobyte-1793449d-6802-4fd3-9884-e5357fb8fbbe" released by "delete_volume" :: held 0.806s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:12:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1bb1fa27-4036-40da-8f23-4bb3bde4313a tempest-VolumesSnapshotListTestJSON-1921258441 None] Create snapshot completed successfully Sep 01 12:12:54 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-2bc948f8-2ad5-461d-acc7-83bd9fa2beac tempest-VolumesActionsTest-1404060246 None] Created reservations ['fcbe2f26-6583-4236-8754-71d1eb1522c3', '1f432d4b-873d-43d5-8186-e70046ad48e2', 'be3d5f8d-7320-46a7-bf89-bb95d813d4f5', 'b60d90d4-56ab-44a4-92fa-ac79fa14f044'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:12:54 devstack sudo[95409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 Sep 01 12:12:54 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2bc948f8-2ad5-461d-acc7-83bd9fa2beac tempest-VolumesActionsTest-1404060246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:12:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2bc948f8-2ad5-461d-acc7-83bd9fa2beac tempest-VolumesActionsTest-1404060246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:12:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2bc948f8-2ad5-461d-acc7-83bd9fa2beac tempest-VolumesActionsTest-1404060246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:12:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2bc948f8-2ad5-461d-acc7-83bd9fa2beac tempest-VolumesActionsTest-1404060246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:12:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2bc948f8-2ad5-461d-acc7-83bd9fa2beac tempest-VolumesActionsTest-1404060246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:12:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2bc948f8-2ad5-461d-acc7-83bd9fa2beac tempest-VolumesActionsTest-1404060246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:54 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:12:54 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:54 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-93f661f0-695a-44a3-9553-77b199f67d62 tempest-VolumesDeleteCascade-1130917395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02" returned: 0 in 0.418s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-93f661f0-695a-44a3-9553-77b199f67d62 tempest-VolumesDeleteCascade-1130917395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:12:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-93f661f0-695a-44a3-9553-77b199f67d62 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:54 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a 1G Sep 01 12:12:54 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:54 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2bc948f8-2ad5-461d-acc7-83bd9fa2beac tempest-VolumesActionsTest-1404060246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.311s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:54 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-2bc948f8-2ad5-461d-acc7-83bd9fa2beac tempest-VolumesActionsTest-1404060246 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:12:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2bc948f8-2ad5-461d-acc7-83bd9fa2beac tempest-VolumesActionsTest-1404060246 None] Deleted volume successfully. Sep 01 12:12:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2bc948f8-2ad5-461d-acc7-83bd9fa2beac tempest-VolumesActionsTest-1404060246 None] Lock "cinder-1793449d-6802-4fd3-9884-e5357fb8fbbe-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:12:55 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-93f661f0-695a-44a3-9553-77b199f67d62 tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a 1G" returned: 0 in 0.684s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-93f661f0-695a-44a3-9553-77b199f67d62 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9b248435-3261-4ff8-97dd-3fc1ffdaf64a tempest-VolumesSnapshotListTestJSON-1921258441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:12:55 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a Sep 01 12:12:55 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:55 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-93f661f0-695a-44a3-9553-77b199f67d62 tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a" returned: 0 in 0.360s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:55 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-93f661f0-695a-44a3-9553-77b199f67d62 tempest-VolumesDeleteCascade-1130917395 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a is being set with open permissions: ugo+rw Sep 01 12:12:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-93f661f0-695a-44a3-9553-77b199f67d62 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:55 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a Sep 01 12:12:55 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:56 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-93f661f0-695a-44a3-9553-77b199f67d62 tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a" returned: 0 in 0.287s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-93f661f0-695a-44a3-9553-77b199f67d62 tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.878s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:12:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9b248435-3261-4ff8-97dd-3fc1ffdaf64a tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.664s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:12:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9b248435-3261-4ff8-97dd-3fc1ffdaf64a tempest-VolumesSnapshotListTestJSON-1921258441 None] Creating offline snapshot ac0fc060-8f5e-4aa8-a560-fdc8db0715dd of volume 1233b117-877c-45dd-b9f9-0f0ae81a91d5 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:12:56 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-93f661f0-695a-44a3-9553-77b199f67d62 tempest-VolumesDeleteCascade-1130917395 None] Create snapshot completed successfully Sep 01 12:12:56 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f64709-9fda-48c7-97d1-292da3fdcf49]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9b248435-3261-4ff8-97dd-3fc1ffdaf64a tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:56 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be Sep 01 12:12:56 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:56 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9b248435-3261-4ff8-97dd-3fc1ffdaf64a tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be" returned: 0 in 0.470s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9b248435-3261-4ff8-97dd-3fc1ffdaf64a tempest-VolumesSnapshotListTestJSON-1921258441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:12:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9b248435-3261-4ff8-97dd-3fc1ffdaf64a tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:56 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd 1G Sep 01 12:12:56 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "cinder-9e39e97f-8c08-4c61-9d78-9b433621ed2d-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:12:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-9e39e97f-8c08-4c61-9d78-9b433621ed2d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:12:57 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9b248435-3261-4ff8-97dd-3fc1ffdaf64a tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd 1G" returned: 0 in 0.622s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9b248435-3261-4ff8-97dd-3fc1ffdaf64a tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Performing cascade delete. {{(pid=87084) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 12:12:57 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd Sep 01 12:12:57 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "cinder-1a315f59-df53-4031-b967-b7dff4d74d02-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:12:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-1a315f59-df53-4031-b967-b7dff4d74d02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:12:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "cinder-quobyte-9e39e97f-8c08-4c61-9d78-9b433621ed2d" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:12:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-9e39e97f-8c08-4c61-9d78-9b433621ed2d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:12:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "cinder-quobyte-1a315f59-df53-4031-b967-b7dff4d74d02" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:12:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-1a315f59-df53-4031-b967-b7dff4d74d02" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:12:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Deleting offline snapshot 1a315f59-df53-4031-b967-b7dff4d74d02 of volume 9e39e97f-8c08-4c61-9d78-9b433621ed2d {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:12:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] snapshot_file for this snap is: volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:12:57 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[174e2df1-375e-4565-9ad2-516ac871faee]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:57 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 Sep 01 12:12:57 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:57 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9b248435-3261-4ff8-97dd-3fc1ffdaf64a tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd" returned: 0 in 0.463s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:57 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-9b248435-3261-4ff8-97dd-3fc1ffdaf64a tempest-VolumesSnapshotListTestJSON-1921258441 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd is being set with open permissions: ugo+rw Sep 01 12:12:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9b248435-3261-4ff8-97dd-3fc1ffdaf64a tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:57 devstack sudo[95451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd Sep 01 12:12:57 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:58 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02" returned: 0 in 0.546s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:12:58 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ece9fe-7f09-4681-ade8-e253e75ffcba]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:58 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9b248435-3261-4ff8-97dd-3fc1ffdaf64a tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd" returned: 0 in 0.337s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9b248435-3261-4ff8-97dd-3fc1ffdaf64a tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.059s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:12:58 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d Sep 01 12:12:58 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:58 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9b248435-3261-4ff8-97dd-3fc1ffdaf64a tempest-VolumesSnapshotListTestJSON-1921258441 None] Create snapshot completed successfully Sep 01 12:12:58 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d" returned: 0 in 0.407s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:58 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cb8c78-5c93-4278-985e-ca946fee9da5]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:58 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a Sep 01 12:12:58 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9bd412d1-9e7a-4636-be3d-cc8180db51b7 tempest-VolumesSnapshotListTestJSON-1921258441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:12:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9bd412d1-9e7a-4636-be3d-cc8180db51b7 tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:12:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9bd412d1-9e7a-4636-be3d-cc8180db51b7 tempest-VolumesSnapshotListTestJSON-1921258441 None] Creating offline snapshot f2657e6c-528f-4852-b028-686df4fb9b72 of volume 1233b117-877c-45dd-b9f9-0f0ae81a91d5 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:12:59 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b140364-8f18-4a0b-9875-a4e8d5d5917f]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9bd412d1-9e7a-4636-be3d-cc8180db51b7 tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:59 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd Sep 01 12:12:59 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:59 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a" returned: 0 in 0.731s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:12:59 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43f4216-7990-4b75-ab9e-c6a963172be6]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:59 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 Sep 01 12:12:59 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:59 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9bd412d1-9e7a-4636-be3d-cc8180db51b7 tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd" returned: 0 in 0.548s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9bd412d1-9e7a-4636-be3d-cc8180db51b7 tempest-VolumesSnapshotListTestJSON-1921258441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:12:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9bd412d1-9e7a-4636-be3d-cc8180db51b7 tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.f2657e6c-528f-4852-b028-686df4fb9b72 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:59 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.f2657e6c-528f-4852-b028-686df4fb9b72 1G Sep 01 12:12:59 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:12:59 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Sep 01 12:12:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02" returned: 0 in 0.511s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:12:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:12:59 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[06292efe-643a-4ba3-b606-a2db9b3dd3ed]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:12:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:12:59 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d Sep 01 12:12:59 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:00 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9bd412d1-9e7a-4636-be3d-cc8180db51b7 tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.f2657e6c-528f-4852-b028-686df4fb9b72 1G" returned: 0 in 0.704s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9bd412d1-9e7a-4636-be3d-cc8180db51b7 tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.f2657e6c-528f-4852-b028-686df4fb9b72 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:00 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.f2657e6c-528f-4852-b028-686df4fb9b72 Sep 01 12:13:00 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:00 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d" returned: 0 in 0.596s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:00 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 Sep 01 12:13:00 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:00 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9bd412d1-9e7a-4636-be3d-cc8180db51b7 tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.f2657e6c-528f-4852-b028-686df4fb9b72" returned: 0 in 0.455s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:00 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-9bd412d1-9e7a-4636-be3d-cc8180db51b7 tempest-VolumesSnapshotListTestJSON-1921258441 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.f2657e6c-528f-4852-b028-686df4fb9b72 is being set with open permissions: ugo+rw Sep 01 12:13:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9bd412d1-9e7a-4636-be3d-cc8180db51b7 tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.f2657e6c-528f-4852-b028-686df4fb9b72 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:00 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.f2657e6c-528f-4852-b028-686df4fb9b72 Sep 01 12:13:00 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:00 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02" returned: 0 in 0.421s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:00 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02 Sep 01 12:13:00 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:01 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9bd412d1-9e7a-4636-be3d-cc8180db51b7 tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.f2657e6c-528f-4852-b028-686df4fb9b72" returned: 0 in 0.317s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:01 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9bd412d1-9e7a-4636-be3d-cc8180db51b7 tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.259s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.1a315f59-df53-4031-b967-b7dff4d74d02" returned: 0 in 0.295s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a -F qcow2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:01 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a -F qcow2 Sep 01 12:13:01 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:01 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9bd412d1-9e7a-4636-be3d-cc8180db51b7 tempest-VolumesSnapshotListTestJSON-1921258441 None] Create snapshot completed successfully Sep 01 12:13:01 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a -F qcow2" returned: 0 in 0.458s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-1a315f59-df53-4031-b967-b7dff4d74d02" released by "_delete_snapshot" :: held 4.188s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-9e39e97f-8c08-4c61-9d78-9b433621ed2d" released by "delete_snapshot" :: held 4.224s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:01 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Created reservations ['5fcae315-d3bc-415e-87cc-c7f18b2fe5e7', '13782772-7ec6-4144-9391-72f44d17ee21', '3d134752-2ed6-4524-bcc0-185aa7a35815', '0d24048f-c236-4ae5-8810-9cc781b29e93'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:13:01 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Delete snapshot completed successfully. Sep 01 12:13:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-1a315f59-df53-4031-b967-b7dff4d74d02-delete_snapshot" released by "delete_snapshot" :: held 4.494s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "cinder-30cc9d72-581b-4d56-b5f8-5a506189ac0a-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-30cc9d72-581b-4d56-b5f8-5a506189ac0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "cinder-quobyte-9e39e97f-8c08-4c61-9d78-9b433621ed2d" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-9e39e97f-8c08-4c61-9d78-9b433621ed2d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "cinder-quobyte-30cc9d72-581b-4d56-b5f8-5a506189ac0a" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-30cc9d72-581b-4d56-b5f8-5a506189ac0a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Deleting offline snapshot 30cc9d72-581b-4d56-b5f8-5a506189ac0a of volume 9e39e97f-8c08-4c61-9d78-9b433621ed2d {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:13:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] snapshot_file for this snap is: volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:13:02 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0df8e67-cf95-4d12-8409-8b06bb071071]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:02 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a Sep 01 12:13:02 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:02 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a" returned: 0 in 0.498s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:13:02 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[541ac906-fd44-4047-9da9-83568616b596]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:02 devstack sudo[95560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d Sep 01 12:13:02 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:03 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] Acquiring lock "cinder-f2657e6c-528f-4852-b028-686df4fb9b72-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d" returned: 0 in 0.475s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-f2657e6c-528f-4852-b028-686df4fb9b72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] Acquiring lock "cinder-quobyte-1233b117-877c-45dd-b9f9-0f0ae81a91d5" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:03 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a Sep 01 12:13:03 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-quobyte-1233b117-877c-45dd-b9f9-0f0ae81a91d5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] Acquiring lock "cinder-quobyte-f2657e6c-528f-4852-b028-686df4fb9b72" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-quobyte-f2657e6c-528f-4852-b028-686df4fb9b72" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] Deleting offline snapshot f2657e6c-528f-4852-b028-686df4fb9b72 of volume 1233b117-877c-45dd-b9f9-0f0ae81a91d5 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] snapshot_file for this snap is: volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.f2657e6c-528f-4852-b028-686df4fb9b72 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef46c02e-4d89-4e58-a77b-bb40738b39c7]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.f2657e6c-528f-4852-b028-686df4fb9b72 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:03 devstack sudo[95567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.f2657e6c-528f-4852-b028-686df4fb9b72 Sep 01 12:13:03 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:03 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a" returned: 0 in 0.425s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:03 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a Sep 01 12:13:03 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:03 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.f2657e6c-528f-4852-b028-686df4fb9b72" returned: 0 in 0.427s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8209b28f-3ea1-4699-a0f2-4609006f9c5d]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:03 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d.30cc9d72-581b-4d56-b5f8-5a506189ac0a" returned: 0 in 0.278s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:03 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd Sep 01 12:13:03 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-30cc9d72-581b-4d56-b5f8-5a506189ac0a" released by "_delete_snapshot" :: held 1.842s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-9e39e97f-8c08-4c61-9d78-9b433621ed2d" released by "delete_snapshot" :: held 1.880s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Created reservations ['0130fb70-954e-45a8-8a10-6f9a3102100b', '314ff51c-1de9-4f27-8ef7-f1fa07bbb088', 'fd828c80-f88e-4a89-8768-9b523538a883', '2914f6c4-6dad-439a-92b4-19726579e3ea'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:13:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Delete snapshot completed successfully. Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-30cc9d72-581b-4d56-b5f8-5a506189ac0a-delete_snapshot" released by "delete_snapshot" :: held 2.112s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Snapshots deleted, issuing volume delete {{(pid=87084) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 12:13:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "cinder-quobyte-9e39e97f-8c08-4c61-9d78-9b433621ed2d" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-9e39e97f-8c08-4c61-9d78-9b433621ed2d" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:04 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd56236-9003-4054-a377-453791deb1b7]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd" returned: 0 in 0.467s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.f2657e6c-528f-4852-b028-686df4fb9b72 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:13:04 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.f2657e6c-528f-4852-b028-686df4fb9b72 Sep 01 12:13:04 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Flow 'volume_create_manager' (3bd7c1b4-496b-4e5e-bf31-4a03e5f3873c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f87b65-97fe-43f0-9ed7-4ece74d2fd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f87b65-97fe-43f0-9ed7-4ece74d2fd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-427813979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8573d9c9-5c5f-4084-833a-ce8496a88419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027a06e29d4747c0945cbcd8fb0ee262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:04Z,use_quota=True,user_id='babafb6a53014dc1ba6861cfd4897fbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e01ac4-ee06-4746-a887-b51bbb629530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e01ac4-ee06-4746-a887-b51bbb629530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a2f9f0b-2411-46b7-9103-703453c606f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG cinder.image.glance [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Creating Keystone auth plugin from conf {{(pid=87084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 12:13:04 devstack sudo[95584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d Sep 01 12:13:04 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a2f9f0b-2411-46b7-9103-703453c606f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8573d9c9-5c5f-4084-833a-ce8496a88419', 'volume_name': 'volume-8573d9c9-5c5f-4084-833a-ce8496a88419', 'volume_size': 1, 'image_id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42fce3cc35724a058187a1135a373ea9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'created_at': datetime.datetime(2026, 9, 1, 9, 59, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 59, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48b02bf-5136-48d5-8c3a-db3a07f10ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48b02bf-5136-48d5-8c3a-db3a07f10ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f25461-9da8-4b2f-bdb5-da4dc1301f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:04 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:04 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Volume 8573d9c9-5c5f-4084-833a-ce8496a88419: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8573d9c9-5c5f-4084-833a-ce8496a88419', 'volume_size': 1, 'image_id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42fce3cc35724a058187a1135a373ea9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'created_at': datetime.datetime(2026, 9, 1, 9, 59, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 59, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Trying to clone 8573d9c9-5c5f-4084-833a-ce8496a88419 from image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}]). {{(pid=87084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d" returned: 0 in 0.390s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:04 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d Sep 01 12:13:04 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:04 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.f2657e6c-528f-4852-b028-686df4fb9b72" returned: 0 in 0.496s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.f2657e6c-528f-4852-b028-686df4fb9b72 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:04 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.f2657e6c-528f-4852-b028-686df4fb9b72 Sep 01 12:13:04 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:04 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9e39e97f-8c08-4c61-9d78-9b433621ed2d" returned: 0 in 0.272s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-9e39e97f-8c08-4c61-9d78-9b433621ed2d" released by "delete_volume" :: held 0.749s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_olpvkbh1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 12:13:04 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Image download 20.69 MB at 20.69 MB/s Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Created reservations ['4064bb3a-3491-486a-b658-a2312eb417b1', '9b6ce7a3-76ae-4452-b5e7-52c50591b8e7', '1cffc41f-d4eb-4ac4-99d1-bb1e314cab16', '30157de2-acca-4ad6-b5fb-0f5b5025df8c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:13:04 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.f2657e6c-528f-4852-b028-686df4fb9b72" returned: 0 in 0.300s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[73adb5d6-31d4-4404-a4e6-6993e36e15cd]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_olpvkbh1devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-quobyte-f2657e6c-528f-4852-b028-686df4fb9b72" released by "_delete_snapshot" :: held 1.814s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-quobyte-1233b117-877c-45dd-b9f9-0f0ae81a91d5" released by "delete_snapshot" :: held 1.852s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:05 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_olpvkbh1devstack@QuobyteHD Sep 01 12:13:05 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:05 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:13:05 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] Created reservations ['73222280-98bd-4f1c-8006-bb8745ca5a9a', '40de4af2-d8d8-42b6-89cf-7c2332feed19', 'd06ca27d-15be-4873-83fa-410fdf5c5760', '2c486c0a-4ee8-46ff-bb68-61f450663f9d'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:13:05 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] Delete snapshot completed successfully. Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c4f9237-4583-4e19-9a51-80be1ce68d31 tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-f2657e6c-528f-4852-b028-686df4fb9b72-delete_snapshot" released by "delete_snapshot" :: held 2.043s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] Acquiring lock "cinder-ac0fc060-8f5e-4aa8-a560-fdc8db0715dd-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-ac0fc060-8f5e-4aa8-a560-fdc8db0715dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] Acquiring lock "cinder-quobyte-1233b117-877c-45dd-b9f9-0f0ae81a91d5" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-quobyte-1233b117-877c-45dd-b9f9-0f0ae81a91d5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] Acquiring lock "cinder-quobyte-ac0fc060-8f5e-4aa8-a560-fdc8db0715dd" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-quobyte-ac0fc060-8f5e-4aa8-a560-fdc8db0715dd" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] Deleting offline snapshot ac0fc060-8f5e-4aa8-a560-fdc8db0715dd of volume 1233b117-877c-45dd-b9f9-0f0ae81a91d5 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] snapshot_file for this snap is: volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:13:05 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d630617-6b7b-4094-8e0e-c504edf2921c]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_olpvkbh1devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Temporary image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c is fetched for user babafb6a53014dc1ba6861cfd4897fbe. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 12:13:05 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.309s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:13:05 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Deleted volume successfully. Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-37b90e40-e3ee-473b-931b-29643ee2c5ba tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-9e39e97f-8c08-4c61-9d78-9b433621ed2d-delete_volume" released by "delete_volume" :: held 8.122s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca72267-4dc0-4238-8bc0-1bdb8839c0a2]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_olpvkbh1devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:05 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd Sep 01 12:13:05 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:05 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_olpvkbh1devstack@QuobyteHD Sep 01 12:13:05 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:05 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd" returned: 0 in 0.379s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd37f84-37d1-4010-bf52-8281a198a8e5]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:05 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_olpvkbh1devstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-427813979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8573d9c9-5c5f-4084-833a-ce8496a88419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027a06e29d4747c0945cbcd8fb0ee262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:04Z,use_quota=True,user_id='babafb6a53014dc1ba6861cfd4897fbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Creating volume 8573d9c9-5c5f-4084-833a-ce8496a88419 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:13:05 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:13:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:05 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419 1073741824 Sep 01 12:13:05 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:05 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be Sep 01 12:13:05 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:06 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be" returned: 0 in 0.402s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:06 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd Sep 01 12:13:06 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:06 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419 1073741824" returned: 0 in 0.504s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:06 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419 Sep 01 12:13:06 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:06 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd" returned: 0 in 0.456s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:06 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419" returned: 0 in 0.302s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:06 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd Sep 01 12:13:06 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Attempting download of 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c ((None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}])) to volume 8573d9c9-5c5f-4084-833a-ce8496a88419. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd825ede-ef8d-4aed-b6f5-c1ddcaac2cda]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_wngaln3c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Flow 'volume_create_manager' (d4dc6893-65d1-41d0-a742-f20e91a3e647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584e5768-e9ec-48fb-abbc-d6083f8a0988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584e5768-e9ec-48fb-abbc-d6083f8a0988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1706970286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f65cbb8-6c1b-4094-a640-fe5e986c8eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dceb145acad4c47be1ee19c4415f6fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:07Z,use_quota=True,user_id='ed1106f9c63a4cf4b2c1e0baabf9f62c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992da615-4c0a-4ade-a076-55c50ffc27cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992da615-4c0a-4ade-a076-55c50ffc27cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0731d4f-4f3f-4aad-b34a-53d923832d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0731d4f-4f3f-4aad-b34a-53d923832d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f65cbb8-6c1b-4094-a640-fe5e986c8eda', 'volume_name': 'volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c79182-ecae-48d6-84dc-7f1ebfbddcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c79182-ecae-48d6-84dc-7f1ebfbddcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:06 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_wngaln3c Sep 01 12:13:06 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1638d6d4-18e5-404e-a882-787c7b5997c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:06 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Volume 8f65cbb8-6c1b-4094-a640-fe5e986c8eda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda', 'volume_size': 1} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1706970286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f65cbb8-6c1b-4094-a640-fe5e986c8eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dceb145acad4c47be1ee19c4415f6fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:07Z,use_quota=True,user_id='ed1106f9c63a4cf4b2c1e0baabf9f62c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Creating volume 8f65cbb8-6c1b-4094-a640-fe5e986c8eda {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:13:06 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:06 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.ac0fc060-8f5e-4aa8-a560-fdc8db0715dd" returned: 0 in 0.262s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:06 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda 1073741824 Sep 01 12:13:06 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-quobyte-ac0fc060-8f5e-4aa8-a560-fdc8db0715dd" released by "_delete_snapshot" :: held 1.620s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-quobyte-1233b117-877c-45dd-b9f9-0f0ae81a91d5" released by "delete_snapshot" :: held 1.652s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:06 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] Created reservations ['5685ce39-4764-476b-b7e9-f63bc48ff4bd', 'cbed811c-3f92-43d3-bce1-a64b8d88ae7c', 'f55b47ff-16e9-4e70-9cfa-71512596a166', 'f18063b7-ef23-4306-904d-78b39642ca84'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:13:06 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] Delete snapshot completed successfully. Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cd46752c-3350-4508-8ce0-2c7f2539e0da tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-ac0fc060-8f5e-4aa8-a560-fdc8db0715dd-delete_snapshot" released by "delete_snapshot" :: held 1.796s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:07 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_wngaln3c" returned: 0 in 0.365s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_wngaln3c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:07 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_wngaln3c Sep 01 12:13:07 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:07 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda 1073741824" returned: 0 in 0.454s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:07 devstack sudo[95656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda Sep 01 12:13:07 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] Acquiring lock "cinder-548e4ff8-b6f2-4aab-a3f8-7b51920a94be-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-548e4ff8-b6f2-4aab-a3f8-7b51920a94be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] Acquiring lock "cinder-quobyte-1233b117-877c-45dd-b9f9-0f0ae81a91d5" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:07 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-quobyte-1233b117-877c-45dd-b9f9-0f0ae81a91d5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] Acquiring lock "cinder-quobyte-548e4ff8-b6f2-4aab-a3f8-7b51920a94be" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_wngaln3c" returned: 1 in 0.367s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_wngaln3c' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1571f7ab-1f31-4385-9d47-9e433d661bfb]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_olpvkbh1devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-quobyte-548e4ff8-b6f2-4aab-a3f8-7b51920a94be" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] Deleting offline snapshot 548e4ff8-b6f2-4aab-a3f8-7b51920a94be of volume 1233b117-877c-45dd-b9f9-0f0ae81a91d5 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] snapshot_file for this snap is: volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[30faa14c-9e3b-4984-91ae-a8d72ce3c50f]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:07 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_olpvkbh1devstack@QuobyteHD Sep 01 12:13:07 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:07 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda" returned: 0 in 0.292s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:07 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be Sep 01 12:13:07 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1638d6d4-18e5-404e-a882-787c7b5997c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39c65dc-4c4f-42a5-954c-9d274728fe59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:07 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Volume volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda (8f65cbb8-6c1b-4094-a640-fe5e986c8eda): created successfully Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39c65dc-4c4f-42a5-954c-9d274728fe59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Flow 'volume_create_manager' (d4dc6893-65d1-41d0-a742-f20e91a3e647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:07 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-241a7a52-8a72-41c1-88de-536782213b92 tempest-VolumesDeleteCascade-1130917395 None] Created volume successfully. Sep 01 12:13:07 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_olpvkbh1devstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c was qcow2, converting to qcow2 {{(pid=87084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_olpvkbh1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:07 devstack sudo[95668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_olpvkbh1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419 Sep 01 12:13:07 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:07 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be" returned: 0 in 0.453s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ee0998-5631-4049-b28b-1235742faf1b]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fb3ad77d-17ef-4753-b1d3-4334acd94f85 tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fb3ad77d-17ef-4753-b1d3-4334acd94f85 tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-fb3ad77d-17ef-4753-b1d3-4334acd94f85 tempest-VolumesDeleteCascade-1130917395 None] Creating offline snapshot 52c7cabe-ae74-414b-b2fb-4dd8297d3c15 of volume 8f65cbb8-6c1b-4094-a640-fe5e986c8eda {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:13:08 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[480a0e6b-25ad-4157-af2c-2f88fc09d40b]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fb3ad77d-17ef-4753-b1d3-4334acd94f85 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:08 devstack sudo[95673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5 Sep 01 12:13:08 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:08 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda Sep 01 12:13:08 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:08 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5" returned: 0 in 0.522s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:08 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fb3ad77d-17ef-4753-b1d3-4334acd94f85 tempest-VolumesDeleteCascade-1130917395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda" returned: 0 in 0.485s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:08 devstack sudo[95693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be Sep 01 12:13:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fb3ad77d-17ef-4753-b1d3-4334acd94f85 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:08 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:08 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15 1G Sep 01 12:13:08 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:08 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be" returned: 0 in 0.463s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:09 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be Sep 01 12:13:09 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:09 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fb3ad77d-17ef-4753-b1d3-4334acd94f85 tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15 1G" returned: 0 in 0.588s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fb3ad77d-17ef-4753-b1d3-4334acd94f85 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:09 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15 Sep 01 12:13:09 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:09 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5.548e4ff8-b6f2-4aab-a3f8-7b51920a94be" returned: 0 in 0.346s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-quobyte-548e4ff8-b6f2-4aab-a3f8-7b51920a94be" released by "_delete_snapshot" :: held 1.933s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-quobyte-1233b117-877c-45dd-b9f9-0f0ae81a91d5" released by "delete_snapshot" :: held 1.970s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:09 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] Created reservations ['d22834f5-2ce5-4f14-98a5-c8f9e9b205e0', 'f087acc1-de47-46ab-87b6-326aa7934d26', '0b951a59-b6c7-4bc5-8ca7-ee29c23d1ef5', 'd79c660f-d925-4572-b113-42fb3bf6b9ed'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:13:09 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fb3ad77d-17ef-4753-b1d3-4334acd94f85 tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15" returned: 0 in 0.441s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:09 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-fb3ad77d-17ef-4753-b1d3-4334acd94f85 tempest-VolumesDeleteCascade-1130917395 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15 is being set with open permissions: ugo+rw Sep 01 12:13:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fb3ad77d-17ef-4753-b1d3-4334acd94f85 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:09 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] Delete snapshot completed successfully. Sep 01 12:13:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cbbd227c-e204-4aad-a264-db4b163e670d tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-548e4ff8-b6f2-4aab-a3f8-7b51920a94be-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:09 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15 Sep 01 12:13:09 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:09 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fb3ad77d-17ef-4753-b1d3-4334acd94f85 tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15" returned: 0 in 0.274s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fb3ad77d-17ef-4753-b1d3-4334acd94f85 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:09 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.info Sep 01 12:13:09 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:09 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_olpvkbh1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419" returned: 0 in 2.163s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:09 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_olpvkbh1devstack@QuobyteHD, size 112.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:13:09 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Converted 112.00 MB image at 51.76 MB/s Sep 01 12:13:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:09 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419 1G Sep 01 12:13:09 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:10 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fb3ad77d-17ef-4753-b1d3-4334acd94f85 tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.info" returned: 0 in 0.277s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:10 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-fb3ad77d-17ef-4753-b1d3-4334acd94f85 tempest-VolumesDeleteCascade-1130917395 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.info is being set with open permissions: ugo+rw Sep 01 12:13:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fb3ad77d-17ef-4753-b1d3-4334acd94f85 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:10 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.info Sep 01 12:13:10 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:10 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419 1G" returned: 0 in 0.351s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:10 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Downloaded image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c ((None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}])) to volume 8573d9c9-5c5f-4084-833a-ce8496a88419 successfully. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 12:13:10 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Temporary image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c for user babafb6a53014dc1ba6861cfd4897fbe is deleted. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 12:13:10 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Marking volume 8573d9c9-5c5f-4084-833a-ce8496a88419 as bootable. {{(pid=87084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 12:13:10 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Copying metadata from image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c to 8573d9c9-5c5f-4084-833a-ce8496a88419. {{(pid=87084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 12:13:10 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Creating volume glance metadata for volume 8573d9c9-5c5f-4084-833a-ce8496a88419 backed by image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 12:13:10 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fb3ad77d-17ef-4753-b1d3-4334acd94f85 tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.info" returned: 0 in 0.273s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fb3ad77d-17ef-4753-b1d3-4334acd94f85 tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f25461-9da8-4b2f-bdb5-da4dc1301f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8573d9c9-5c5f-4084-833a-ce8496a88419', 'volume_size': 1, 'image_id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42fce3cc35724a058187a1135a373ea9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'created_at': datetime.datetime(2026, 9, 1, 9, 59, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 59, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a31beb-3a70-4c82-8b80-f4a8bedd33ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:10 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-fb3ad77d-17ef-4753-b1d3-4334acd94f85 tempest-VolumesDeleteCascade-1130917395 None] Create snapshot completed successfully Sep 01 12:13:10 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Volume volume-8573d9c9-5c5f-4084-833a-ce8496a88419 (8573d9c9-5c5f-4084-833a-ce8496a88419): created successfully Sep 01 12:13:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a31beb-3a70-4c82-8b80-f4a8bedd33ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Flow 'volume_create_manager' (3bd7c1b4-496b-4e5e-bf31-4a03e5f3873c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:10 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9d3e7199-706e-4a05-8591-7d54869ee9d4 tempest-VolumesExtendTest-50205787 None] Created volume successfully. Sep 01 12:13:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-15f25c09-46ae-47e7-8067-578f4ab1a27f tempest-VolumesSnapshotListTestJSON-1921258441 None] Acquiring lock "cinder-1233b117-877c-45dd-b9f9-0f0ae81a91d5-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-15f25c09-46ae-47e7-8067-578f4ab1a27f tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-1233b117-877c-45dd-b9f9-0f0ae81a91d5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-15f25c09-46ae-47e7-8067-578f4ab1a27f tempest-VolumesSnapshotListTestJSON-1921258441 None] Acquiring lock "cinder-quobyte-1233b117-877c-45dd-b9f9-0f0ae81a91d5" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-15f25c09-46ae-47e7-8067-578f4ab1a27f tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-quobyte-1233b117-877c-45dd-b9f9-0f0ae81a91d5" acquired by "delete_volume" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:10 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbea29e3-b84d-446b-a108-81bd6207e135]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15f25c09-46ae-47e7-8067-578f4ab1a27f tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:10 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5 Sep 01 12:13:10 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:11 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15f25c09-46ae-47e7-8067-578f4ab1a27f tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5" returned: 0 in 0.352s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15f25c09-46ae-47e7-8067-578f4ab1a27f tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:11 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5 Sep 01 12:13:11 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:11 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15f25c09-46ae-47e7-8067-578f4ab1a27f tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1233b117-877c-45dd-b9f9-0f0ae81a91d5" returned: 0 in 0.260s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-15f25c09-46ae-47e7-8067-578f4ab1a27f tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-quobyte-1233b117-877c-45dd-b9f9-0f0ae81a91d5" released by "delete_volume" :: held 0.668s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-15f25c09-46ae-47e7-8067-578f4ab1a27f tempest-VolumesSnapshotListTestJSON-1921258441 None] Created reservations ['f523e60e-c59d-46e7-b462-f1b827fa6694', 'cf4e6da5-168e-423d-b6c1-c56f67181b7a', '9396c176-c815-4f8c-9775-1e8f85e0c7fd', 'fefc2457-6390-4781-b981-446aecff16cb'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-15f25c09-46ae-47e7-8067-578f4ab1a27f tempest-VolumesSnapshotListTestJSON-1921258441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-15f25c09-46ae-47e7-8067-578f4ab1a27f tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-15f25c09-46ae-47e7-8067-578f4ab1a27f tempest-VolumesSnapshotListTestJSON-1921258441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-15f25c09-46ae-47e7-8067-578f4ab1a27f tempest-VolumesSnapshotListTestJSON-1921258441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-15f25c09-46ae-47e7-8067-578f4ab1a27f tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15f25c09-46ae-47e7-8067-578f4ab1a27f tempest-VolumesSnapshotListTestJSON-1921258441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:11 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:13:11 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-338833ce-8871-4fdb-9e7c-828f809f565b tempest-VolumesExtendTest-50205787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-338833ce-8871-4fdb-9e7c-828f809f565b tempest-VolumesExtendTest-50205787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0204c2d6-94df-4667-bec0-088e6e3efbd1]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-338833ce-8871-4fdb-9e7c-828f809f565b tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:13:11 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-15f25c09-46ae-47e7-8067-578f4ab1a27f tempest-VolumesSnapshotListTestJSON-1921258441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.278s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-15f25c09-46ae-47e7-8067-578f4ab1a27f tempest-VolumesSnapshotListTestJSON-1921258441 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Flow 'volume_create_manager' (ecf92f8f-8de1-416a-8122-f33055ea1bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb741843-5788-4db1-85e8-2c77244fe13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:11 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-15f25c09-46ae-47e7-8067-578f4ab1a27f tempest-VolumesSnapshotListTestJSON-1921258441 None] Deleted volume successfully. Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb741843-5788-4db1-85e8-2c77244fe13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1475097431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12628577-4d61-45c2-ab5f-f6637216c64e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dceb145acad4c47be1ee19c4415f6fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=52c7cabe-ae74-414b-b2fb-4dd8297d3c15,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:12Z,use_quota=True,user_id='ed1106f9c63a4cf4b2c1e0baabf9f62c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8e5845-4eff-4320-a5e7-8644f03a2766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8e5845-4eff-4320-a5e7-8644f03a2766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:11 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419 Sep 01 12:13:11 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433d15a6-64bf-4318-8ad6-c9bd408da47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433d15a6-64bf-4318-8ad6-c9bd408da47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '12628577-4d61-45c2-ab5f-f6637216c64e', 'volume_name': 'volume-12628577-4d61-45c2-ab5f-f6637216c64e', 'volume_size': 1, 'snapshot_id': '52c7cabe-ae74-414b-b2fb-4dd8297d3c15'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3033465d-7a26-473c-85f7-dab4620a83c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3033465d-7a26-473c-85f7-dab4620a83c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77fd8c6e-249b-40c7-9e39-041ea8ff243b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:11 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Volume 12628577-4d61-45c2-ab5f-f6637216c64e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-12628577-4d61-45c2-ab5f-f6637216c64e', 'volume_size': 1, 'snapshot_id': '52c7cabe-ae74-414b-b2fb-4dd8297d3c15'} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-15f25c09-46ae-47e7-8067-578f4ab1a27f tempest-VolumesSnapshotListTestJSON-1921258441 None] Lock "cinder-1233b117-877c-45dd-b9f9-0f0ae81a91d5-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:12 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-338833ce-8871-4fdb-9e7c-828f809f565b tempest-VolumesExtendTest-50205787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419" returned: 0 in 0.407s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-338833ce-8871-4fdb-9e7c-828f809f565b tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419 2G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-338833ce-8871-4fdb-9e7c-828f809f565b tempest-VolumesExtendTest-50205787 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419 2G" returned: 0 in 0.101s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-338833ce-8871-4fdb-9e7c-828f809f565b tempest-VolumesExtendTest-50205787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.536s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.345s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "cinder-quobyte-52c7cabe-ae74-414b-b2fb-4dd8297d3c15-12628577-4d61-45c2-ab5f-f6637216c64e" by "_create_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-52c7cabe-ae74-414b-b2fb-4dd8297d3c15-12628577-4d61-45c2-ab5f-f6637216c64e" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Creating volume 12628577-4d61-45c2-ab5f-f6637216c64e from snapshot 52c7cabe-ae74-414b-b2fb-4dd8297d3c15 {{(pid=87084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "cinder-quobyte-12628577-4d61-45c2-ab5f-f6637216c64e" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-12628577-4d61-45c2-ab5f-f6637216c64e" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] snapshot: 52c7cabe-ae74-414b-b2fb-4dd8297d3c15, volume: 12628577-4d61-45c2-ab5f-f6637216c64e, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:13:12 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-338833ce-8871-4fdb-9e7c-828f809f565b tempest-VolumesExtendTest-50205787 None] Extend volume completed successfully. Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bff2222-4192-4cf7-98af-b56488f8afae]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:12 devstack sudo[95748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15 Sep 01 12:13:12 devstack sudo[95748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:12 devstack sudo[95748]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15" returned: 0 in 0.472s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cd4c73-881d-43eb-9e6c-977cf142310c]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1d7817b1-4588-41a5-a126-d1d0beb53f46 tempest-VolumesExtendTest-50205787 None] Acquiring lock "cinder-8573d9c9-5c5f-4084-833a-ce8496a88419-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1d7817b1-4588-41a5-a126-d1d0beb53f46 tempest-VolumesExtendTest-50205787 None] Lock "cinder-8573d9c9-5c5f-4084-833a-ce8496a88419-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1d7817b1-4588-41a5-a126-d1d0beb53f46 tempest-VolumesExtendTest-50205787 None] Acquiring lock "cinder-quobyte-8573d9c9-5c5f-4084-833a-ce8496a88419" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1d7817b1-4588-41a5-a126-d1d0beb53f46 tempest-VolumesExtendTest-50205787 None] Lock "cinder-quobyte-8573d9c9-5c5f-4084-833a-ce8496a88419" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:13 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda Sep 01 12:13:13 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2bec7c-718a-41cb-9058-2e631d12df83]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d7817b1-4588-41a5-a126-d1d0beb53f46 tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:13 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419 Sep 01 12:13:13 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:13 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda" returned: 0 in 0.523s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Path /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-12628577-4d61-45c2-ab5f-f6637216c64e not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-12628577-4d61-45c2-ab5f-f6637216c64e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:13 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-12628577-4d61-45c2-ab5f-f6637216c64e Sep 01 12:13:13 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Flow 'volume_create_manager' (e0bf7331-81bd-443d-9f24-e0cfc10d0df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b026cd1-86a2-476c-9cf5-0f477964746f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b026cd1-86a2-476c-9cf5-0f477964746f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2125666349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d25ff4b9-042b-4833-8e7f-d6cd18d6861c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55e72c87e374d6ca6ac118393a2c204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:13Z,use_quota=True,user_id='d467767cd2dd4a19a729441172901fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56be5f0f-ec81-4dcb-b3db-7c2beef05bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56be5f0f-ec81-4dcb-b3db-7c2beef05bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca2658a8-96de-4a9d-b427-313834a7bbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca2658a8-96de-4a9d-b427-313834a7bbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd25ff4b9-042b-4833-8e7f-d6cd18d6861c', 'volume_name': 'volume-d25ff4b9-042b-4833-8e7f-d6cd18d6861c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3c6147-543d-4e9a-9537-e392f4d947af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3c6147-543d-4e9a-9537-e392f4d947af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b3998f-68a4-4ccf-be84-43a2e8cad3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:13 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Volume d25ff4b9-042b-4833-8e7f-d6cd18d6861c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d25ff4b9-042b-4833-8e7f-d6cd18d6861c', 'volume_size': 1} Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:13 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d7817b1-4588-41a5-a126-d1d0beb53f46 tempest-VolumesExtendTest-50205787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419" returned: 0 in 0.505s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d7817b1-4588-41a5-a126-d1d0beb53f46 tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:13 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419 Sep 01 12:13:13 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:13 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d7817b1-4588-41a5-a126-d1d0beb53f46 tempest-VolumesExtendTest-50205787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8573d9c9-5c5f-4084-833a-ce8496a88419" returned: 0 in 0.281s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1d7817b1-4588-41a5-a126-d1d0beb53f46 tempest-VolumesExtendTest-50205787 None] Lock "cinder-quobyte-8573d9c9-5c5f-4084-833a-ce8496a88419" released by "delete_volume" :: held 0.845s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:14 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-1d7817b1-4588-41a5-a126-d1d0beb53f46 tempest-VolumesExtendTest-50205787 None] Created reservations ['50afb442-6d84-4033-a108-38666a0b62d8', 'eb019f22-97cd-448b-ad94-268a677f8aa4', 'f2194480-4fab-443e-a861-67da5d8111b3', 'f5d07757-4879-4ecf-9ac8-e8ff7766fbba'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:13:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d7817b1-4588-41a5-a126-d1d0beb53f46 tempest-VolumesExtendTest-50205787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d7817b1-4588-41a5-a126-d1d0beb53f46 tempest-VolumesExtendTest-50205787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1d7817b1-4588-41a5-a126-d1d0beb53f46 tempest-VolumesExtendTest-50205787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1d7817b1-4588-41a5-a126-d1d0beb53f46 tempest-VolumesExtendTest-50205787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d7817b1-4588-41a5-a126-d1d0beb53f46 tempest-VolumesExtendTest-50205787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d7817b1-4588-41a5-a126-d1d0beb53f46 tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:14 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:13:14 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:15 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d7817b1-4588-41a5-a126-d1d0beb53f46 tempest-VolumesExtendTest-50205787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.906s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:15 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-1d7817b1-4588-41a5-a126-d1d0beb53f46 tempest-VolumesExtendTest-50205787 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:13:15 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1d7817b1-4588-41a5-a126-d1d0beb53f46 tempest-VolumesExtendTest-50205787 None] Deleted volume successfully. Sep 01 12:13:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1d7817b1-4588-41a5-a126-d1d0beb53f46 tempest-VolumesExtendTest-50205787 None] Lock "cinder-8573d9c9-5c5f-4084-833a-ce8496a88419-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:16 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:13:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Flow 'volume_create_manager' (ad3d3feb-7b95-45d9-95cd-acd0f95506e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22b2214-9492-4e8d-90dd-3ca4b7407764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22b2214-9492-4e8d-90dd-3ca4b7407764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-826514193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8691355a-fc71-4aa2-8b94-07acdffde9fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027a06e29d4747c0945cbcd8fb0ee262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:16Z,use_quota=True,user_id='babafb6a53014dc1ba6861cfd4897fbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63d700d-145e-4d9f-968b-84629da3ade4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63d700d-145e-4d9f-968b-84629da3ade4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efed0864-d74f-4bc4-9d7e-bc7c2e6edc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efed0864-d74f-4bc4-9d7e-bc7c2e6edc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8691355a-fc71-4aa2-8b94-07acdffde9fe', 'volume_name': 'volume-8691355a-fc71-4aa2-8b94-07acdffde9fe', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40235d1-ef78-4511-9cf8-0ec6e5c199dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40235d1-ef78-4511-9cf8-0ec6e5c199dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be5910c-ddb2-494a-8198-faca7d361a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:16 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Volume 8691355a-fc71-4aa2-8b94-07acdffde9fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8691355a-fc71-4aa2-8b94-07acdffde9fe', 'volume_size': 1} Sep 01 12:13:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:19 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-12628577-4d61-45c2-ab5f-f6637216c64e" returned: 0 in 5.652s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-12628577-4d61-45c2-ab5f-f6637216c64e {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:13:19 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Converted 1024.00 MB image at 181.14 MB/s Sep 01 12:13:19 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-12628577-4d61-45c2-ab5f-f6637216c64e is being set with open permissions: ugo+rw Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-12628577-4d61-45c2-ab5f-f6637216c64e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:19 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-12628577-4d61-45c2-ab5f-f6637216c64e Sep 01 12:13:19 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:19 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-12628577-4d61-45c2-ab5f-f6637216c64e" returned: 0 in 0.266s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-12628577-4d61-45c2-ab5f-f6637216c64e" released by "_copy_volume_from_snapshot" :: held 7.008s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-52c7cabe-ae74-414b-b2fb-4dd8297d3c15-12628577-4d61-45c2-ab5f-f6637216c64e" released by "_create_volume_from_snapshot" :: held 7.085s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.109s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.808s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2125666349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d25ff4b9-042b-4833-8e7f-d6cd18d6861c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55e72c87e374d6ca6ac118393a2c204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:13Z,use_quota=True,user_id='d467767cd2dd4a19a729441172901fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Creating volume d25ff4b9-042b-4833-8e7f-d6cd18d6861c {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:13:19 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d25ff4b9-042b-4833-8e7f-d6cd18d6861c 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:19 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d25ff4b9-042b-4833-8e7f-d6cd18d6861c 1073741824 Sep 01 12:13:19 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77fd8c6e-249b-40c7-9e39-041ea8ff243b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12628577-4d61-45c2-ab5f-f6637216c64e', 'volume_size': 1, 'snapshot_id': '52c7cabe-ae74-414b-b2fb-4dd8297d3c15'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c869068-b9bb-4423-bcf7-1e8de5c8f2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:19 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Volume volume-12628577-4d61-45c2-ab5f-f6637216c64e (12628577-4d61-45c2-ab5f-f6637216c64e): created successfully Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c869068-b9bb-4423-bcf7-1e8de5c8f2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Flow 'volume_create_manager' (ecf92f8f-8de1-416a-8122-f33055ea1bd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:19 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-10fce6cb-b0eb-4e9f-a4c8-44193693e94e tempest-VolumesDeleteCascade-1130917395 None] Created volume successfully. Sep 01 12:13:19 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d25ff4b9-042b-4833-8e7f-d6cd18d6861c 1073741824" returned: 0 in 0.430s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d25ff4b9-042b-4833-8e7f-d6cd18d6861c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:19 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d25ff4b9-042b-4833-8e7f-d6cd18d6861c Sep 01 12:13:19 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:20 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d25ff4b9-042b-4833-8e7f-d6cd18d6861c" returned: 0 in 0.240s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.350s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-826514193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8691355a-fc71-4aa2-8b94-07acdffde9fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027a06e29d4747c0945cbcd8fb0ee262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:16Z,use_quota=True,user_id='babafb6a53014dc1ba6861cfd4897fbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Creating volume 8691355a-fc71-4aa2-8b94-07acdffde9fe {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:13:20 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b3998f-68a4-4ccf-be84-43a2e8cad3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d25ff4b9-042b-4833-8e7f-d6cd18d6861c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdfbc4f9-d934-4c3f-b487-c1d33a8bd543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:20 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe 1073741824 Sep 01 12:13:20 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:20 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Volume volume-d25ff4b9-042b-4833-8e7f-d6cd18d6861c (d25ff4b9-042b-4833-8e7f-d6cd18d6861c): created successfully Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdfbc4f9-d934-4c3f-b487-c1d33a8bd543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Flow 'volume_create_manager' (e0bf7331-81bd-443d-9f24-e0cfc10d0df9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:20 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d4c05d58-f23f-456c-8137-9255d67afa7e tempest-AttachVolumeNegativeTest-36464837 None] Created volume successfully. Sep 01 12:13:20 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe 1073741824" returned: 0 in 0.460s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:20 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe Sep 01 12:13:20 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "cinder-8f65cbb8-6c1b-4094-a640-fe5e986c8eda-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-8f65cbb8-6c1b-4094-a640-fe5e986c8eda-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Performing cascade delete. {{(pid=87084) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "cinder-52c7cabe-ae74-414b-b2fb-4dd8297d3c15-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-52c7cabe-ae74-414b-b2fb-4dd8297d3c15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "cinder-quobyte-8f65cbb8-6c1b-4094-a640-fe5e986c8eda" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-8f65cbb8-6c1b-4094-a640-fe5e986c8eda" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "cinder-quobyte-52c7cabe-ae74-414b-b2fb-4dd8297d3c15" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-52c7cabe-ae74-414b-b2fb-4dd8297d3c15" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Deleting offline snapshot 52c7cabe-ae74-414b-b2fb-4dd8297d3c15 of volume 8f65cbb8-6c1b-4094-a640-fe5e986c8eda {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] snapshot_file for this snap is: volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:13:20 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe" returned: 0 in 0.273s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fd4f39-6fe8-4c36-acbf-798030e9b9ac]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be5910c-ddb2-494a-8198-faca7d361a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8691355a-fc71-4aa2-8b94-07acdffde9fe', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60aa3497-de6d-437c-9813-c36caa01a3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:20 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Volume volume-8691355a-fc71-4aa2-8b94-07acdffde9fe (8691355a-fc71-4aa2-8b94-07acdffde9fe): created successfully Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60aa3497-de6d-437c-9813-c36caa01a3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Flow 'volume_create_manager' (ad3d3feb-7b95-45d9-95cd-acd0f95506e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:20 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e45fdf72-10af-41c8-a145-83f8f2fa893c tempest-VolumesExtendTest-50205787 None] Created volume successfully. Sep 01 12:13:21 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15 Sep 01 12:13:21 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:21 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15" returned: 0 in 0.416s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:13:21 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f5e208-a39f-47e9-9f69-54fa4430838a]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:21 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda Sep 01 12:13:21 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d9331b1b-b845-498a-9597-98de0572155c tempest-VolumesExtendTest-50205787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d9331b1b-b845-498a-9597-98de0572155c tempest-VolumesExtendTest-50205787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-d9331b1b-b845-498a-9597-98de0572155c tempest-VolumesExtendTest-50205787 None] Creating offline snapshot 384b2cbe-8836-4299-8604-1d9aba40ff16 of volume 8691355a-fc71-4aa2-8b94-07acdffde9fe {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:13:22 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09b46bc-b268-4988-989d-048dfee489f4]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d9331b1b-b845-498a-9597-98de0572155c tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:22 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda" returned: 0 in 0.961s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:22 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe Sep 01 12:13:22 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:22 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15 Sep 01 12:13:22 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:22 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d9331b1b-b845-498a-9597-98de0572155c tempest-VolumesExtendTest-50205787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe" returned: 0 in 0.478s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d9331b1b-b845-498a-9597-98de0572155c tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:22 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16 1G Sep 01 12:13:22 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:22 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15" returned: 0 in 0.445s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:22 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15 Sep 01 12:13:22 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-59cae88b-1c8c-4e42-9e09-6ac44d24959e req-e0454cba-abc3-40bb-8754-ee6207393db8 tempest-AttachVolumeNegativeTest-36464837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:23 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda.52c7cabe-ae74-414b-b2fb-4dd8297d3c15" returned: 0 in 0.310s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-52c7cabe-ae74-414b-b2fb-4dd8297d3c15" released by "_delete_snapshot" :: held 2.243s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-8f65cbb8-6c1b-4094-a640-fe5e986c8eda" released by "delete_snapshot" :: held 2.273s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:23 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Created reservations ['5cb708cc-88b1-400c-86c3-794eeb3dffce', '7d6c11f2-97c4-4687-bc7e-b804e2b18387', '3b364fa6-e78b-418d-ade5-eef96e7865ce', '92079ecd-88be-438b-a1e0-549985593973'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:13:23 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d9331b1b-b845-498a-9597-98de0572155c tempest-VolumesExtendTest-50205787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16 1G" returned: 0 in 0.588s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d9331b1b-b845-498a-9597-98de0572155c tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8691355a-fc71-4aa2-8b94-07acdffde9fe -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:23 devstack sudo[95887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8691355a-fc71-4aa2-8b94-07acdffde9fe -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16 Sep 01 12:13:23 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Delete snapshot completed successfully. Sep 01 12:13:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-52c7cabe-ae74-414b-b2fb-4dd8297d3c15-delete_snapshot" released by "delete_snapshot" :: held 2.503s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Snapshots deleted, issuing volume delete {{(pid=87084) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 12:13:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "cinder-quobyte-8f65cbb8-6c1b-4094-a640-fe5e986c8eda" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-8f65cbb8-6c1b-4094-a640-fe5e986c8eda" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:23 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf66f2e-89ea-488a-b20f-b0af9a2fbb2a]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:23 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda Sep 01 12:13:23 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:23 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d9331b1b-b845-498a-9597-98de0572155c tempest-VolumesExtendTest-50205787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8691355a-fc71-4aa2-8b94-07acdffde9fe -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16" returned: 0 in 0.337s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:23 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-d9331b1b-b845-498a-9597-98de0572155c tempest-VolumesExtendTest-50205787 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16 is being set with open permissions: ugo+rw Sep 01 12:13:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d9331b1b-b845-498a-9597-98de0572155c tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:23 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16 Sep 01 12:13:23 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:23 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda" returned: 0 in 0.419s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:23 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda Sep 01 12:13:23 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:23 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d9331b1b-b845-498a-9597-98de0572155c tempest-VolumesExtendTest-50205787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16" returned: 0 in 0.296s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d9331b1b-b845-498a-9597-98de0572155c tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:23 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.info Sep 01 12:13:23 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:24 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8f65cbb8-6c1b-4094-a640-fe5e986c8eda" returned: 0 in 0.247s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-8f65cbb8-6c1b-4094-a640-fe5e986c8eda" released by "delete_volume" :: held 0.736s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Created reservations ['cc1356b1-b6a6-4f38-a6f5-fed05511e67b', 'b65a5382-ffca-4060-91cd-5e8e57bc5cd1', 'da52f64e-adc9-4923-ba2a-a9c4e03c4fd9', '1907699f-801e-40ef-97a7-1e137ddee86a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:13:24 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d9331b1b-b845-498a-9597-98de0572155c tempest-VolumesExtendTest-50205787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.info" returned: 0 in 0.316s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:24 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-d9331b1b-b845-498a-9597-98de0572155c tempest-VolumesExtendTest-50205787 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.info is being set with open permissions: ugo+rw Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d9331b1b-b845-498a-9597-98de0572155c tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:24 devstack sudo[95907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.info Sep 01 12:13:24 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:24 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:13:24 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:24 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d9331b1b-b845-498a-9597-98de0572155c tempest-VolumesExtendTest-50205787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.info" returned: 0 in 0.365s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d9331b1b-b845-498a-9597-98de0572155c tempest-VolumesExtendTest-50205787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.540s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:24 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-59cae88b-1c8c-4e42-9e09-6ac44d24959e req-e0454cba-abc3-40bb-8754-ee6207393db8 tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.690s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.360s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:13:24 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Deleted volume successfully. Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-59cae88b-1c8c-4e42-9e09-6ac44d24959e req-e0454cba-abc3-40bb-8754-ee6207393db8 tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f47e5cb4-d3f9-4e43-aeda-8daccfad2918 tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "cinder-12628577-4d61-45c2-ab5f-f6637216c64e-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:24 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d9331b1b-b845-498a-9597-98de0572155c tempest-VolumesExtendTest-50205787 None] Create snapshot completed successfully Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f47e5cb4-d3f9-4e43-aeda-8daccfad2918 tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-12628577-4d61-45c2-ab5f-f6637216c64e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-57600be9-0a12-45bc-8427-37d50b03ef27 tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-8f65cbb8-6c1b-4094-a640-fe5e986c8eda-delete_volume" released by "delete_volume" :: held 3.973s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-59cae88b-1c8c-4e42-9e09-6ac44d24959e req-e0454cba-abc3-40bb-8754-ee6207393db8 tempest-AttachVolumeNegativeTest-36464837 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-d25ff4b9-042b-4833-8e7f-d6cd18d6861c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a930ca1e-8d10-4b1a-bfde-d0bf6205c58e', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f47e5cb4-d3f9-4e43-aeda-8daccfad2918 tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "cinder-quobyte-12628577-4d61-45c2-ab5f-f6637216c64e" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f47e5cb4-d3f9-4e43-aeda-8daccfad2918 tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-12628577-4d61-45c2-ab5f-f6637216c64e" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:24 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-59cae88b-1c8c-4e42-9e09-6ac44d24959e req-e0454cba-abc3-40bb-8754-ee6207393db8 tempest-AttachVolumeNegativeTest-36464837 None] attachment_update completed successfully. Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab5b136-0d9b-417c-b2d3-a838b04e118e]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47e5cb4-d3f9-4e43-aeda-8daccfad2918 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-12628577-4d61-45c2-ab5f-f6637216c64e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:24 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-12628577-4d61-45c2-ab5f-f6637216c64e Sep 01 12:13:24 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:25 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47e5cb4-d3f9-4e43-aeda-8daccfad2918 tempest-VolumesDeleteCascade-1130917395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-12628577-4d61-45c2-ab5f-f6637216c64e" returned: 0 in 0.438s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47e5cb4-d3f9-4e43-aeda-8daccfad2918 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-12628577-4d61-45c2-ab5f-f6637216c64e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:25 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-12628577-4d61-45c2-ab5f-f6637216c64e Sep 01 12:13:25 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-270b228e-7599-47d0-98ca-2f1fb09826e5 tempest-VolumesExtendTest-50205787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-270b228e-7599-47d0-98ca-2f1fb09826e5 tempest-VolumesExtendTest-50205787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:25 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61b26a7-a996-4cf9-8c76-2388010b5802]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-270b228e-7599-47d0-98ca-2f1fb09826e5 tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:25 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47e5cb4-d3f9-4e43-aeda-8daccfad2918 tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-12628577-4d61-45c2-ab5f-f6637216c64e" returned: 0 in 0.401s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f47e5cb4-d3f9-4e43-aeda-8daccfad2918 tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-quobyte-12628577-4d61-45c2-ab5f-f6637216c64e" released by "delete_volume" :: held 0.900s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:25 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-f47e5cb4-d3f9-4e43-aeda-8daccfad2918 tempest-VolumesDeleteCascade-1130917395 None] Created reservations ['33a69aef-7f88-4e2d-b263-d8776d1c0a7d', '9af6c220-fee0-4c05-9dc6-5054d4a99e42', '9d1a945f-c6e8-4317-bd4b-d939b49513e6', '745b55e1-68a7-4a16-a9e5-15d720d7f811'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:13:25 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe Sep 01 12:13:25 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f47e5cb4-d3f9-4e43-aeda-8daccfad2918 tempest-VolumesDeleteCascade-1130917395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f47e5cb4-d3f9-4e43-aeda-8daccfad2918 tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f47e5cb4-d3f9-4e43-aeda-8daccfad2918 tempest-VolumesDeleteCascade-1130917395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f47e5cb4-d3f9-4e43-aeda-8daccfad2918 tempest-VolumesDeleteCascade-1130917395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f47e5cb4-d3f9-4e43-aeda-8daccfad2918 tempest-VolumesDeleteCascade-1130917395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47e5cb4-d3f9-4e43-aeda-8daccfad2918 tempest-VolumesDeleteCascade-1130917395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:25 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:13:25 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:26 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-270b228e-7599-47d0-98ca-2f1fb09826e5 tempest-VolumesExtendTest-50205787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe" returned: 0 in 0.660s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-270b228e-7599-47d0-98ca-2f1fb09826e5 tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16 2G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:26 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f47e5cb4-d3f9-4e43-aeda-8daccfad2918 tempest-VolumesDeleteCascade-1130917395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.489s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:26 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-f47e5cb4-d3f9-4e43-aeda-8daccfad2918 tempest-VolumesDeleteCascade-1130917395 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:13:26 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f47e5cb4-d3f9-4e43-aeda-8daccfad2918 tempest-VolumesDeleteCascade-1130917395 None] Deleted volume successfully. Sep 01 12:13:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f47e5cb4-d3f9-4e43-aeda-8daccfad2918 tempest-VolumesDeleteCascade-1130917395 None] Lock "cinder-12628577-4d61-45c2-ab5f-f6637216c64e-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-270b228e-7599-47d0-98ca-2f1fb09826e5 tempest-VolumesExtendTest-50205787 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16 2G" returned: 0 in 0.242s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-270b228e-7599-47d0-98ca-2f1fb09826e5 tempest-VolumesExtendTest-50205787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.980s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:26 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-270b228e-7599-47d0-98ca-2f1fb09826e5 tempest-VolumesExtendTest-50205787 None] Extend volume completed successfully. Sep 01 12:13:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] Acquiring lock "cinder-384b2cbe-8836-4299-8604-1d9aba40ff16-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] Lock "cinder-384b2cbe-8836-4299-8604-1d9aba40ff16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] Acquiring lock "cinder-quobyte-8691355a-fc71-4aa2-8b94-07acdffde9fe" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] Lock "cinder-quobyte-8691355a-fc71-4aa2-8b94-07acdffde9fe" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] Acquiring lock "cinder-quobyte-384b2cbe-8836-4299-8604-1d9aba40ff16" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] Lock "cinder-quobyte-384b2cbe-8836-4299-8604-1d9aba40ff16" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] Deleting offline snapshot 384b2cbe-8836-4299-8604-1d9aba40ff16 of volume 8691355a-fc71-4aa2-8b94-07acdffde9fe {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:13:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] snapshot_file for this snap is: volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:13:27 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[443da350-cf6b-407b-827e-15e401f083da]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:27 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16 Sep 01 12:13:27 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:27 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16" returned: 0 in 0.432s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8691355a-fc71-4aa2-8b94-07acdffde9fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:13:27 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed247eb-95af-4fbd-8ad1-afb6b4d1fe5b]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:27 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe Sep 01 12:13:27 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:28 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe" returned: 0 in 0.541s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:28 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16 Sep 01 12:13:28 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:28 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16" returned: 0 in 0.680s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:28 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16 Sep 01 12:13:28 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:29 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe.384b2cbe-8836-4299-8604-1d9aba40ff16" returned: 0 in 0.389s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] Lock "cinder-quobyte-384b2cbe-8836-4299-8604-1d9aba40ff16" released by "_delete_snapshot" :: held 2.187s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] Lock "cinder-quobyte-8691355a-fc71-4aa2-8b94-07acdffde9fe" released by "delete_snapshot" :: held 2.216s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:29 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] Created reservations ['76a18440-7d77-49e5-aebe-88b3fd3afaef', 'df0b5c41-fad2-4226-96bd-bcc1f57c6049', '2725c118-f4ff-4865-83d6-30bc081785f3', '1a2cd0d2-a349-48be-9c30-cbfbfa3c6490'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:13:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] Delete snapshot completed successfully. Sep 01 12:13:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c0273bf8-ba65-4c16-8646-409ef74030a9 tempest-VolumesExtendTest-50205787 None] Lock "cinder-384b2cbe-8836-4299-8604-1d9aba40ff16-delete_snapshot" released by "delete_snapshot" :: held 2.476s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a2c3460f-70d2-4eb7-b720-bf1864e497ea tempest-VolumesExtendTest-50205787 None] Acquiring lock "cinder-8691355a-fc71-4aa2-8b94-07acdffde9fe-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a2c3460f-70d2-4eb7-b720-bf1864e497ea tempest-VolumesExtendTest-50205787 None] Lock "cinder-8691355a-fc71-4aa2-8b94-07acdffde9fe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:30 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=124,cinder:INSERT=41,cinder:UPDATE=123,cinder:DELETE=9 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:13:30 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=127,cinder:DELETE=11,cinder:SELECT=118,cinder:INSERT=35 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:13:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a2c3460f-70d2-4eb7-b720-bf1864e497ea tempest-VolumesExtendTest-50205787 None] Acquiring lock "cinder-quobyte-8691355a-fc71-4aa2-8b94-07acdffde9fe" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a2c3460f-70d2-4eb7-b720-bf1864e497ea tempest-VolumesExtendTest-50205787 None] Lock "cinder-quobyte-8691355a-fc71-4aa2-8b94-07acdffde9fe" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:30 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23d0975-df1d-4a59-99a5-16b04cb99325]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2c3460f-70d2-4eb7-b720-bf1864e497ea tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:30 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe Sep 01 12:13:30 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:30 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2c3460f-70d2-4eb7-b720-bf1864e497ea tempest-VolumesExtendTest-50205787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe" returned: 0 in 0.449s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2c3460f-70d2-4eb7-b720-bf1864e497ea tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:30 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe Sep 01 12:13:30 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:31 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2c3460f-70d2-4eb7-b720-bf1864e497ea tempest-VolumesExtendTest-50205787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8691355a-fc71-4aa2-8b94-07acdffde9fe" returned: 0 in 0.360s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a2c3460f-70d2-4eb7-b720-bf1864e497ea tempest-VolumesExtendTest-50205787 None] Lock "cinder-quobyte-8691355a-fc71-4aa2-8b94-07acdffde9fe" released by "delete_volume" :: held 0.899s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:31 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a2c3460f-70d2-4eb7-b720-bf1864e497ea tempest-VolumesExtendTest-50205787 None] Created reservations ['ae9f1b92-112d-4fd1-9312-c725f86a4195', '40518049-4b6a-451e-b0d4-b56748dbdbfd', 'd4583f6a-c235-4806-be06-3af8bf50f82f', '6032dd27-7be5-4a8e-8bee-6cf7553e90a1'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:13:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a2c3460f-70d2-4eb7-b720-bf1864e497ea tempest-VolumesExtendTest-50205787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a2c3460f-70d2-4eb7-b720-bf1864e497ea tempest-VolumesExtendTest-50205787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a2c3460f-70d2-4eb7-b720-bf1864e497ea tempest-VolumesExtendTest-50205787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a2c3460f-70d2-4eb7-b720-bf1864e497ea tempest-VolumesExtendTest-50205787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a2c3460f-70d2-4eb7-b720-bf1864e497ea tempest-VolumesExtendTest-50205787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2c3460f-70d2-4eb7-b720-bf1864e497ea tempest-VolumesExtendTest-50205787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:31 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:13:31 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:31 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a2c3460f-70d2-4eb7-b720-bf1864e497ea tempest-VolumesExtendTest-50205787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.391s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:31 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-a2c3460f-70d2-4eb7-b720-bf1864e497ea tempest-VolumesExtendTest-50205787 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:13:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a2c3460f-70d2-4eb7-b720-bf1864e497ea tempest-VolumesExtendTest-50205787 None] Deleted volume successfully. Sep 01 12:13:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a2c3460f-70d2-4eb7-b720-bf1864e497ea tempest-VolumesExtendTest-50205787 None] Lock "cinder-8691355a-fc71-4aa2-8b94-07acdffde9fe-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Flow 'volume_create_manager' (2a74609d-cdcf-48a8-8f7f-78811954f215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5b10e0-1c75-4b7d-933b-d8a3b25282b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5b10e0-1c75-4b7d-933b-d8a3b25282b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-776789767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f2cc155-4140-440f-bb8d-b12457f3660d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598b361e712f4d6abc189696857bbc7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:34Z,use_quota=True,user_id='f4d0b137e16d46bfa354c077855338d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e884dc92-584c-480e-a931-c2beefd10c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e884dc92-584c-480e-a931-c2beefd10c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49458b1c-e421-4461-8d39-9404dcc15e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49458b1c-e421-4461-8d39-9404dcc15e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f2cc155-4140-440f-bb8d-b12457f3660d', 'volume_name': 'volume-5f2cc155-4140-440f-bb8d-b12457f3660d', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6731060d-41c1-4690-af7a-a369232cd6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6731060d-41c1-4690-af7a-a369232cd6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b7ce28-7994-4852-b458-ac3a47a1620d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:33 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Volume 5f2cc155-4140-440f-bb8d-b12457f3660d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f2cc155-4140-440f-bb8d-b12457f3660d', 'volume_size': 1} Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-776789767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f2cc155-4140-440f-bb8d-b12457f3660d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598b361e712f4d6abc189696857bbc7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:34Z,use_quota=True,user_id='f4d0b137e16d46bfa354c077855338d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Creating volume 5f2cc155-4140-440f-bb8d-b12457f3660d {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:13:33 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:13:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f2cc155-4140-440f-bb8d-b12457f3660d 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:33 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f2cc155-4140-440f-bb8d-b12457f3660d 1073741824 Sep 01 12:13:33 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:34 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f2cc155-4140-440f-bb8d-b12457f3660d 1073741824" returned: 0 in 0.609s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f2cc155-4140-440f-bb8d-b12457f3660d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:34 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f2cc155-4140-440f-bb8d-b12457f3660d Sep 01 12:13:34 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:34 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f2cc155-4140-440f-bb8d-b12457f3660d" returned: 0 in 0.377s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:13:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b7ce28-7994-4852-b458-ac3a47a1620d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f2cc155-4140-440f-bb8d-b12457f3660d', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8624e778-824f-4369-a978-9a4429239b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:34 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Volume volume-5f2cc155-4140-440f-bb8d-b12457f3660d (5f2cc155-4140-440f-bb8d-b12457f3660d): created successfully Sep 01 12:13:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8624e778-824f-4369-a978-9a4429239b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Flow 'volume_create_manager' (2a74609d-cdcf-48a8-8f7f-78811954f215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:34 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d51fa3d6-c16a-4c6e-a6ab-0a127655d57e tempest-VolumesTransfersV355Test-2111738153 None] Created volume successfully. Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Flow 'volume_create_manager' (ac76ef24-ad97-4a61-b9f3-442695b78aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7f298d-d2e4-471d-b081-b72d18eba3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7f298d-d2e4-471d-b081-b72d18eba3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1601768781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2179e231-0d6d-4d24-accd-421ba2c99275,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='645e221d3e9f4446931a48ea2539d472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:36Z,use_quota=True,user_id='a75d133e057e4151a23843d4742a9da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8436da75-a7a6-4cec-a8ce-4cd7596def1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8436da75-a7a6-4cec-a8ce-4cd7596def1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3cb84ba-d1d6-4c4a-94fd-d0ea0a7d32ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3cb84ba-d1d6-4c4a-94fd-d0ea0a7d32ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2179e231-0d6d-4d24-accd-421ba2c99275', 'volume_name': 'volume-2179e231-0d6d-4d24-accd-421ba2c99275', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329399b0-a860-454f-a314-1447d8a62615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329399b0-a860-454f-a314-1447d8a62615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c584e387-c578-4648-a0c9-5e2ebe28549e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:36 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Volume 2179e231-0d6d-4d24-accd-421ba2c99275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2179e231-0d6d-4d24-accd-421ba2c99275', 'volume_size': 1} Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1601768781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2179e231-0d6d-4d24-accd-421ba2c99275,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='645e221d3e9f4446931a48ea2539d472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:36Z,use_quota=True,user_id='a75d133e057e4151a23843d4742a9da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Creating volume 2179e231-0d6d-4d24-accd-421ba2c99275 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:13:36 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2179e231-0d6d-4d24-accd-421ba2c99275 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:36 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2179e231-0d6d-4d24-accd-421ba2c99275 1073741824 Sep 01 12:13:36 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:36 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-99e4074b-938b-45ee-8f1e-6ae62e410766 tempest-VolumesTransfersV355Test-1316755558 None] Transfer volume completed successfully. Sep 01 12:13:36 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2179e231-0d6d-4d24-accd-421ba2c99275 1073741824" returned: 0 in 0.627s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2179e231-0d6d-4d24-accd-421ba2c99275 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:36 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2179e231-0d6d-4d24-accd-421ba2c99275 Sep 01 12:13:36 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:37 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2179e231-0d6d-4d24-accd-421ba2c99275" returned: 0 in 0.438s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:13:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c584e387-c578-4648-a0c9-5e2ebe28549e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2179e231-0d6d-4d24-accd-421ba2c99275', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807fc876-2916-4e37-91b1-301cfaeac9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8a20b98d-fe99-47d6-b9bd-7570904a59d7 tempest-VolumesTransfersV355Test-1797871779 None] Acquiring lock "cinder-5f2cc155-4140-440f-bb8d-b12457f3660d-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:37 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Volume volume-2179e231-0d6d-4d24-accd-421ba2c99275 (2179e231-0d6d-4d24-accd-421ba2c99275): created successfully Sep 01 12:13:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807fc876-2916-4e37-91b1-301cfaeac9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Flow 'volume_create_manager' (ac76ef24-ad97-4a61-b9f3-442695b78aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8a20b98d-fe99-47d6-b9bd-7570904a59d7 tempest-VolumesTransfersV355Test-1797871779 None] Lock "cinder-5f2cc155-4140-440f-bb8d-b12457f3660d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6b9ee8a1-8372-4d05-a5ce-6e91161be9a1 tempest-VolumesGetTest-73630739 None] Created volume successfully. Sep 01 12:13:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8a20b98d-fe99-47d6-b9bd-7570904a59d7 tempest-VolumesTransfersV355Test-1797871779 None] Acquiring lock "cinder-quobyte-5f2cc155-4140-440f-bb8d-b12457f3660d" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8a20b98d-fe99-47d6-b9bd-7570904a59d7 tempest-VolumesTransfersV355Test-1797871779 None] Lock "cinder-quobyte-5f2cc155-4140-440f-bb8d-b12457f3660d" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:37 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e6898c-9aba-40ca-9c6e-cbca886ff0ce]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8a20b98d-fe99-47d6-b9bd-7570904a59d7 tempest-VolumesTransfersV355Test-1797871779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f2cc155-4140-440f-bb8d-b12457f3660d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:37 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f2cc155-4140-440f-bb8d-b12457f3660d Sep 01 12:13:37 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:37 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8a20b98d-fe99-47d6-b9bd-7570904a59d7 tempest-VolumesTransfersV355Test-1797871779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f2cc155-4140-440f-bb8d-b12457f3660d" returned: 0 in 0.434s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8a20b98d-fe99-47d6-b9bd-7570904a59d7 tempest-VolumesTransfersV355Test-1797871779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f2cc155-4140-440f-bb8d-b12457f3660d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:37 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f2cc155-4140-440f-bb8d-b12457f3660d Sep 01 12:13:37 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:38 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8a20b98d-fe99-47d6-b9bd-7570904a59d7 tempest-VolumesTransfersV355Test-1797871779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f2cc155-4140-440f-bb8d-b12457f3660d" returned: 0 in 0.292s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8a20b98d-fe99-47d6-b9bd-7570904a59d7 tempest-VolumesTransfersV355Test-1797871779 None] Lock "cinder-quobyte-5f2cc155-4140-440f-bb8d-b12457f3660d" released by "delete_volume" :: held 0.787s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:38 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-8a20b98d-fe99-47d6-b9bd-7570904a59d7 tempest-VolumesTransfersV355Test-1797871779 None] Created reservations ['936dea41-de48-4977-a0dd-f8afb1d8059b', '329cdbf7-dd27-49bd-a97a-f506f90fa813', 'b5476075-9f58-4f21-9756-94883cad0cc3', '63481769-c5d5-4f19-bccf-0750514ccf40'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:13:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8a20b98d-fe99-47d6-b9bd-7570904a59d7 tempest-VolumesTransfersV355Test-1797871779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8a20b98d-fe99-47d6-b9bd-7570904a59d7 tempest-VolumesTransfersV355Test-1797871779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8a20b98d-fe99-47d6-b9bd-7570904a59d7 tempest-VolumesTransfersV355Test-1797871779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8a20b98d-fe99-47d6-b9bd-7570904a59d7 tempest-VolumesTransfersV355Test-1797871779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8a20b98d-fe99-47d6-b9bd-7570904a59d7 tempest-VolumesTransfersV355Test-1797871779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8a20b98d-fe99-47d6-b9bd-7570904a59d7 tempest-VolumesTransfersV355Test-1797871779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:38 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:13:38 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:38 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8a20b98d-fe99-47d6-b9bd-7570904a59d7 tempest-VolumesTransfersV355Test-1797871779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.324s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:38 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-8a20b98d-fe99-47d6-b9bd-7570904a59d7 tempest-VolumesTransfersV355Test-1797871779 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:13:38 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8a20b98d-fe99-47d6-b9bd-7570904a59d7 tempest-VolumesTransfersV355Test-1797871779 None] Deleted volume successfully. Sep 01 12:13:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8a20b98d-fe99-47d6-b9bd-7570904a59d7 tempest-VolumesTransfersV355Test-1797871779 None] Lock "cinder-5f2cc155-4140-440f-bb8d-b12457f3660d-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Flow 'volume_create_manager' (b96c7133-6c3e-4492-b411-edfeabfec7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec910984-bf91-4c09-8ab5-874b709ffe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec910984-bf91-4c09-8ab5-874b709ffe6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1353108232',display_name='tempest-VolumesGetTest-Volume-539038736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d4c2ec-aad8-4375-8702-b6446f607bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645e221d3e9f4446931a48ea2539d472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:39Z,use_quota=True,user_id='a75d133e057e4151a23843d4742a9da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16d5470-588e-4943-9419-62289ff5e102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16d5470-588e-4943-9419-62289ff5e102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91a325a-0db3-43ee-b47f-bda55de4ee12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91a325a-0db3-43ee-b47f-bda55de4ee12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7d4c2ec-aad8-4375-8702-b6446f607bcf', 'volume_name': 'volume-f7d4c2ec-aad8-4375-8702-b6446f607bcf', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba73ea61-601f-4e1d-8875-7d2d3de4fe82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba73ea61-601f-4e1d-8875-7d2d3de4fe82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e68cc4-fa38-4166-8042-5bf1aef4a4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Volume f7d4c2ec-aad8-4375-8702-b6446f607bcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7d4c2ec-aad8-4375-8702-b6446f607bcf', 'volume_size': 1} Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1353108232',display_name='tempest-VolumesGetTest-Volume-539038736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d4c2ec-aad8-4375-8702-b6446f607bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645e221d3e9f4446931a48ea2539d472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:39Z,use_quota=True,user_id='a75d133e057e4151a23843d4742a9da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Creating volume f7d4c2ec-aad8-4375-8702-b6446f607bcf {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:13:39 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:13:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f7d4c2ec-aad8-4375-8702-b6446f607bcf 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:39 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f7d4c2ec-aad8-4375-8702-b6446f607bcf 1073741824 Sep 01 12:13:39 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:40 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f7d4c2ec-aad8-4375-8702-b6446f607bcf 1073741824" returned: 0 in 0.817s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f7d4c2ec-aad8-4375-8702-b6446f607bcf {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:40 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f7d4c2ec-aad8-4375-8702-b6446f607bcf Sep 01 12:13:40 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:40 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:13:40 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Flow 'volume_create_manager' (f4cd11f8-c24a-4837-abd8-d0d2e389ff8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e810f26f-52d8-45ce-87bd-ab93a65e79a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f7d4c2ec-aad8-4375-8702-b6446f607bcf" returned: 0 in 0.559s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:13:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e810f26f-52d8-45ce-87bd-ab93a65e79a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-501982972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27817485-0f09-446f-9729-49c61523be3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598b361e712f4d6abc189696857bbc7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:41Z,use_quota=True,user_id='f4d0b137e16d46bfa354c077855338d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d49f469-2e94-40d8-bbda-f462ae825ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d49f469-2e94-40d8-bbda-f462ae825ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83dbc19e-bf68-46ef-8c2a-28e713f974b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83dbc19e-bf68-46ef-8c2a-28e713f974b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27817485-0f09-446f-9729-49c61523be3b', 'volume_name': 'volume-27817485-0f09-446f-9729-49c61523be3b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2722de-121b-4694-a689-0884780e1345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2722de-121b-4694-a689-0884780e1345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90f51cc-8665-48b8-bc62-5806f9de377f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Volume 27817485-0f09-446f-9729-49c61523be3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27817485-0f09-446f-9729-49c61523be3b', 'volume_size': 1} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-501982972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27817485-0f09-446f-9729-49c61523be3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598b361e712f4d6abc189696857bbc7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:41Z,use_quota=True,user_id='f4d0b137e16d46bfa354c077855338d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Creating volume 27817485-0f09-446f-9729-49c61523be3b {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:13:41 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-27817485-0f09-446f-9729-49c61523be3b 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e68cc4-fa38-4166-8042-5bf1aef4a4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7d4c2ec-aad8-4375-8702-b6446f607bcf', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b277d03c-7238-4fd1-9514-b2fe4f29a399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:41 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-27817485-0f09-446f-9729-49c61523be3b 1073741824 Sep 01 12:13:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Volume volume-f7d4c2ec-aad8-4375-8702-b6446f607bcf (f7d4c2ec-aad8-4375-8702-b6446f607bcf): created successfully Sep 01 12:13:41 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b277d03c-7238-4fd1-9514-b2fe4f29a399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Flow 'volume_create_manager' (b96c7133-6c3e-4492-b411-edfeabfec7eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-903c5e13-0db4-4ee8-8fa8-4df13727216d tempest-VolumesGetTest-73630739 None] Created volume successfully. Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0fe5e877-5a80-47d2-b04c-d86af05af7c4 tempest-VolumesGetTest-73630739 None] Acquiring lock "cinder-f7d4c2ec-aad8-4375-8702-b6446f607bcf-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0fe5e877-5a80-47d2-b04c-d86af05af7c4 tempest-VolumesGetTest-73630739 None] Lock "cinder-f7d4c2ec-aad8-4375-8702-b6446f607bcf-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:41 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:13:41 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0fe5e877-5a80-47d2-b04c-d86af05af7c4 tempest-VolumesGetTest-73630739 None] Acquiring lock "cinder-quobyte-f7d4c2ec-aad8-4375-8702-b6446f607bcf" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0fe5e877-5a80-47d2-b04c-d86af05af7c4 tempest-VolumesGetTest-73630739 None] Lock "cinder-quobyte-f7d4c2ec-aad8-4375-8702-b6446f607bcf" acquired by "delete_volume" :: waited 0.038s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:41 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-27817485-0f09-446f-9729-49c61523be3b 1073741824" returned: 0 in 0.873s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:42 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df76c99-241b-42f8-b743-1044c770ccea]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0fe5e877-5a80-47d2-b04c-d86af05af7c4 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f7d4c2ec-aad8-4375-8702-b6446f607bcf {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-27817485-0f09-446f-9729-49c61523be3b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:42 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-27817485-0f09-446f-9729-49c61523be3b Sep 01 12:13:42 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:42 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f7d4c2ec-aad8-4375-8702-b6446f607bcf Sep 01 12:13:42 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:42 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.736s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:13:42 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:13:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:13:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:13:42 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0fe5e877-5a80-47d2-b04c-d86af05af7c4 tempest-VolumesGetTest-73630739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f7d4c2ec-aad8-4375-8702-b6446f607bcf" returned: 0 in 0.623s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0fe5e877-5a80-47d2-b04c-d86af05af7c4 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f7d4c2ec-aad8-4375-8702-b6446f607bcf {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:42 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-27817485-0f09-446f-9729-49c61523be3b" returned: 0 in 0.572s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:13:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:42 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f7d4c2ec-aad8-4375-8702-b6446f607bcf Sep 01 12:13:42 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90f51cc-8665-48b8-bc62-5806f9de377f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27817485-0f09-446f-9729-49c61523be3b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f8478da-65bc-4b71-8b49-86198a5117df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:42 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Volume volume-27817485-0f09-446f-9729-49c61523be3b (27817485-0f09-446f-9729-49c61523be3b): created successfully Sep 01 12:13:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f8478da-65bc-4b71-8b49-86198a5117df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Flow 'volume_create_manager' (f4cd11f8-c24a-4837-abd8-d0d2e389ff8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:42 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3d2ca988-9e00-4025-95a0-6094628f99c7 tempest-VolumesTransfersV355Test-2111738153 None] Created volume successfully. Sep 01 12:13:43 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0fe5e877-5a80-47d2-b04c-d86af05af7c4 tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f7d4c2ec-aad8-4375-8702-b6446f607bcf" returned: 0 in 0.366s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0fe5e877-5a80-47d2-b04c-d86af05af7c4 tempest-VolumesGetTest-73630739 None] Lock "cinder-quobyte-f7d4c2ec-aad8-4375-8702-b6446f607bcf" released by "delete_volume" :: held 1.071s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:43 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-0fe5e877-5a80-47d2-b04c-d86af05af7c4 tempest-VolumesGetTest-73630739 None] Created reservations ['95295309-c941-4f55-b1e4-64636fae19b8', '8c808b25-28b2-49a7-a9c5-548fb9f8e5ad', 'e3a03328-5c10-4a83-a8a8-9a8866f7bcbd', '2edef227-89fd-45d8-862c-894a383cf243'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:13:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0fe5e877-5a80-47d2-b04c-d86af05af7c4 tempest-VolumesGetTest-73630739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0fe5e877-5a80-47d2-b04c-d86af05af7c4 tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0fe5e877-5a80-47d2-b04c-d86af05af7c4 tempest-VolumesGetTest-73630739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0fe5e877-5a80-47d2-b04c-d86af05af7c4 tempest-VolumesGetTest-73630739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0fe5e877-5a80-47d2-b04c-d86af05af7c4 tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0fe5e877-5a80-47d2-b04c-d86af05af7c4 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:43 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:13:43 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:43 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0fe5e877-5a80-47d2-b04c-d86af05af7c4 tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.266s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:43 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-0fe5e877-5a80-47d2-b04c-d86af05af7c4 tempest-VolumesGetTest-73630739 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:13:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0fe5e877-5a80-47d2-b04c-d86af05af7c4 tempest-VolumesGetTest-73630739 None] Deleted volume successfully. Sep 01 12:13:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0fe5e877-5a80-47d2-b04c-d86af05af7c4 tempest-VolumesGetTest-73630739 None] Lock "cinder-f7d4c2ec-aad8-4375-8702-b6446f607bcf-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ce15b661-5550-4ae5-a2c2-a9f908f0d9fe tempest-VolumesGetTest-73630739 None] Acquiring lock "cinder-2179e231-0d6d-4d24-accd-421ba2c99275-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e25dd2fc-11bd-433b-94b5-7fd9dea4fcf4 tempest-VolumesTransfersV355Test-1797871779 None] Acquiring lock "cinder-27817485-0f09-446f-9729-49c61523be3b-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ce15b661-5550-4ae5-a2c2-a9f908f0d9fe tempest-VolumesGetTest-73630739 None] Lock "cinder-2179e231-0d6d-4d24-accd-421ba2c99275-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e25dd2fc-11bd-433b-94b5-7fd9dea4fcf4 tempest-VolumesTransfersV355Test-1797871779 None] Lock "cinder-27817485-0f09-446f-9729-49c61523be3b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e25dd2fc-11bd-433b-94b5-7fd9dea4fcf4 tempest-VolumesTransfersV355Test-1797871779 None] Acquiring lock "cinder-quobyte-27817485-0f09-446f-9729-49c61523be3b" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ce15b661-5550-4ae5-a2c2-a9f908f0d9fe tempest-VolumesGetTest-73630739 None] Acquiring lock "cinder-quobyte-2179e231-0d6d-4d24-accd-421ba2c99275" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ce15b661-5550-4ae5-a2c2-a9f908f0d9fe tempest-VolumesGetTest-73630739 None] Lock "cinder-quobyte-2179e231-0d6d-4d24-accd-421ba2c99275" acquired by "delete_volume" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e25dd2fc-11bd-433b-94b5-7fd9dea4fcf4 tempest-VolumesTransfersV355Test-1797871779 None] Lock "cinder-quobyte-27817485-0f09-446f-9729-49c61523be3b" acquired by "delete_volume" :: waited 0.051s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:44 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b36703f-8f7d-4c0f-a6d5-9a1801f578b2]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ce15b661-5550-4ae5-a2c2-a9f908f0d9fe tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2179e231-0d6d-4d24-accd-421ba2c99275 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:44 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[837ff55b-f9c5-47b0-a4e2-bb067d660b20]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e25dd2fc-11bd-433b-94b5-7fd9dea4fcf4 tempest-VolumesTransfersV355Test-1797871779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-27817485-0f09-446f-9729-49c61523be3b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:44 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2179e231-0d6d-4d24-accd-421ba2c99275 Sep 01 12:13:44 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:44 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-27817485-0f09-446f-9729-49c61523be3b Sep 01 12:13:44 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:44 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e25dd2fc-11bd-433b-94b5-7fd9dea4fcf4 tempest-VolumesTransfersV355Test-1797871779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-27817485-0f09-446f-9729-49c61523be3b" returned: 0 in 0.401s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e25dd2fc-11bd-433b-94b5-7fd9dea4fcf4 tempest-VolumesTransfersV355Test-1797871779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-27817485-0f09-446f-9729-49c61523be3b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:44 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ce15b661-5550-4ae5-a2c2-a9f908f0d9fe tempest-VolumesGetTest-73630739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2179e231-0d6d-4d24-accd-421ba2c99275" returned: 0 in 0.432s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ce15b661-5550-4ae5-a2c2-a9f908f0d9fe tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2179e231-0d6d-4d24-accd-421ba2c99275 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:44 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-27817485-0f09-446f-9729-49c61523be3b Sep 01 12:13:44 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:44 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2179e231-0d6d-4d24-accd-421ba2c99275 Sep 01 12:13:44 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:45 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e25dd2fc-11bd-433b-94b5-7fd9dea4fcf4 tempest-VolumesTransfersV355Test-1797871779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-27817485-0f09-446f-9729-49c61523be3b" returned: 0 in 0.292s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e25dd2fc-11bd-433b-94b5-7fd9dea4fcf4 tempest-VolumesTransfersV355Test-1797871779 None] Lock "cinder-quobyte-27817485-0f09-446f-9729-49c61523be3b" released by "delete_volume" :: held 0.750s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:45 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ce15b661-5550-4ae5-a2c2-a9f908f0d9fe tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2179e231-0d6d-4d24-accd-421ba2c99275" returned: 0 in 0.305s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ce15b661-5550-4ae5-a2c2-a9f908f0d9fe tempest-VolumesGetTest-73630739 None] Lock "cinder-quobyte-2179e231-0d6d-4d24-accd-421ba2c99275" released by "delete_volume" :: held 0.800s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:45 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-e25dd2fc-11bd-433b-94b5-7fd9dea4fcf4 tempest-VolumesTransfersV355Test-1797871779 None] Created reservations ['bb3bf144-9ae6-45c6-be3a-8ef593805ad6', '5400cfc9-32f7-46ce-b614-6ba374831248', '698971a8-78e4-4288-92a2-aae455a400e8', '66a50ea9-d465-4136-b9b6-fd3615129ac4'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:13:45 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-ce15b661-5550-4ae5-a2c2-a9f908f0d9fe tempest-VolumesGetTest-73630739 None] Created reservations ['289ffe04-9266-4f9c-828e-087152a7aa45', '2af6d1d4-a3fb-401d-87b2-49a140412832', '036932f2-85bb-4a43-8208-a1be539f0a90', '9268a594-be84-4f3d-a810-cf24c37068f2'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:13:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e25dd2fc-11bd-433b-94b5-7fd9dea4fcf4 tempest-VolumesTransfersV355Test-1797871779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e25dd2fc-11bd-433b-94b5-7fd9dea4fcf4 tempest-VolumesTransfersV355Test-1797871779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e25dd2fc-11bd-433b-94b5-7fd9dea4fcf4 tempest-VolumesTransfersV355Test-1797871779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e25dd2fc-11bd-433b-94b5-7fd9dea4fcf4 tempest-VolumesTransfersV355Test-1797871779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e25dd2fc-11bd-433b-94b5-7fd9dea4fcf4 tempest-VolumesTransfersV355Test-1797871779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e25dd2fc-11bd-433b-94b5-7fd9dea4fcf4 tempest-VolumesTransfersV355Test-1797871779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:45 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:13:45 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ce15b661-5550-4ae5-a2c2-a9f908f0d9fe tempest-VolumesGetTest-73630739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ce15b661-5550-4ae5-a2c2-a9f908f0d9fe tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ce15b661-5550-4ae5-a2c2-a9f908f0d9fe tempest-VolumesGetTest-73630739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ce15b661-5550-4ae5-a2c2-a9f908f0d9fe tempest-VolumesGetTest-73630739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ce15b661-5550-4ae5-a2c2-a9f908f0d9fe tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ce15b661-5550-4ae5-a2c2-a9f908f0d9fe tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:45 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:13:45 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:45 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e25dd2fc-11bd-433b-94b5-7fd9dea4fcf4 tempest-VolumesTransfersV355Test-1797871779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.555s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:45 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-e25dd2fc-11bd-433b-94b5-7fd9dea4fcf4 tempest-VolumesTransfersV355Test-1797871779 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:13:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e25dd2fc-11bd-433b-94b5-7fd9dea4fcf4 tempest-VolumesTransfersV355Test-1797871779 None] Deleted volume successfully. Sep 01 12:13:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e25dd2fc-11bd-433b-94b5-7fd9dea4fcf4 tempest-VolumesTransfersV355Test-1797871779 None] Lock "cinder-27817485-0f09-446f-9729-49c61523be3b-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:46 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ce15b661-5550-4ae5-a2c2-a9f908f0d9fe tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.814s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:46 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-ce15b661-5550-4ae5-a2c2-a9f908f0d9fe tempest-VolumesGetTest-73630739 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:13:46 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ce15b661-5550-4ae5-a2c2-a9f908f0d9fe tempest-VolumesGetTest-73630739 None] Deleted volume successfully. Sep 01 12:13:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ce15b661-5550-4ae5-a2c2-a9f908f0d9fe tempest-VolumesGetTest-73630739 None] Lock "cinder-2179e231-0d6d-4d24-accd-421ba2c99275-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:13:46 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:13:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Flow 'volume_create_manager' (3f83ddd2-a636-487b-a768-bce6e6fade23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ae4b77-6a00-4318-b817-01eaa6459c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ae4b77-6a00-4318-b817-01eaa6459c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-378544434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a65d31f-779f-4baa-b8ba-6ccef0c3c65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645e221d3e9f4446931a48ea2539d472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:47Z,use_quota=True,user_id='a75d133e057e4151a23843d4742a9da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd3bd44-35bb-4648-9d88-6e9f04810437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd3bd44-35bb-4648-9d88-6e9f04810437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca34e054-fb42-431a-b12b-2fe69aa185f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca34e054-fb42-431a-b12b-2fe69aa185f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a65d31f-779f-4baa-b8ba-6ccef0c3c65c', 'volume_name': 'volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93ab372-1b7a-41ab-a5ca-65a32f6194fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93ab372-1b7a-41ab-a5ca-65a32f6194fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179f51a0-fbfb-43aa-9aec-bea983579d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:46 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Volume 1a65d31f-779f-4baa-b8ba-6ccef0c3c65c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c', 'volume_size': 1} Sep 01 12:13:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-378544434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a65d31f-779f-4baa-b8ba-6ccef0c3c65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645e221d3e9f4446931a48ea2539d472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:47Z,use_quota=True,user_id='a75d133e057e4151a23843d4742a9da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:13:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Creating volume 1a65d31f-779f-4baa-b8ba-6ccef0c3c65c {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:13:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:13:47 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:13:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:47 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c 1073741824 Sep 01 12:13:47 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:47 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c 1073741824" returned: 0 in 0.988s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:48 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c Sep 01 12:13:48 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:48 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c" returned: 0 in 0.558s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:13:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179f51a0-fbfb-43aa-9aec-bea983579d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056141d6-b152-4d7d-a188-6f66e2298bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:48 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Volume volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c (1a65d31f-779f-4baa-b8ba-6ccef0c3c65c): created successfully Sep 01 12:13:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056141d6-b152-4d7d-a188-6f66e2298bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Flow 'volume_create_manager' (3f83ddd2-a636-487b-a768-bce6e6fade23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-74438362-d20d-4798-8501-fe3bdcc666e3 tempest-VolumesGetTest-73630739 None] Created volume successfully. Sep 01 12:13:50 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:13:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Flow 'volume_create_manager' (2fd327d4-3c9c-4982-a992-7cfda6e898ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66fc1369-e9f9-4d9a-a765-19d0f0b915aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66fc1369-e9f9-4d9a-a765-19d0f0b915aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-834177902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bfe7247-8e94-419c-944a-b3a51536435c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='645e221d3e9f4446931a48ea2539d472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1a65d31f-779f-4baa-b8ba-6ccef0c3c65c,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:50Z,use_quota=True,user_id='a75d133e057e4151a23843d4742a9da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc05efa-957d-44dc-af4f-929304b1e8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc05efa-957d-44dc-af4f-929304b1e8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce0e6844-4964-4f60-988c-ca15eef870cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce0e6844-4964-4f60-988c-ca15eef870cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0bfe7247-8e94-419c-944a-b3a51536435c', 'volume_name': 'volume-0bfe7247-8e94-419c-944a-b3a51536435c', 'volume_size': 1, 'source_volid': '1a65d31f-779f-4baa-b8ba-6ccef0c3c65c', 'source_volstatus': 'available'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ad3611-9500-4d0d-8f9b-eefe4b1a5b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ad3611-9500-4d0d-8f9b-eefe4b1a5b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f443b7-366d-4505-b595-a109ed0bd324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:50 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Volume 0bfe7247-8e94-419c-944a-b3a51536435c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0bfe7247-8e94-419c-944a-b3a51536435c', 'volume_size': 1, 'source_volid': '1a65d31f-779f-4baa-b8ba-6ccef0c3c65c', 'source_volstatus': 'available'} Sep 01 12:13:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:50 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Cloning volume 1a65d31f-779f-4baa-b8ba-6ccef0c3c65c to volume 0bfe7247-8e94-419c-944a-b3a51536435c Sep 01 12:13:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Creating offline snapshot 64111c6b-278e-48d6-9b5c-00a6d3420085 of volume 1a65d31f-779f-4baa-b8ba-6ccef0c3c65c {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:13:50 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[317cd737-0667-46ec-ba0b-c526b13aa491]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:50 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c Sep 01 12:13:50 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:50 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c" returned: 0 in 0.592s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:51 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085 1G Sep 01 12:13:51 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:51 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085 1G" returned: 0 in 0.884s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:51 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085 Sep 01 12:13:51 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:52 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085" returned: 0 in 0.477s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:52 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085 is being set with open permissions: ugo+rw Sep 01 12:13:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:52 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085 Sep 01 12:13:52 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:52 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085" returned: 0 in 0.348s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:52 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.info Sep 01 12:13:52 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:53 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.info" returned: 0 in 0.362s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:53 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.info is being set with open permissions: ugo+rw Sep 01 12:13:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:53 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.info Sep 01 12:13:53 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:53 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.info" returned: 0 in 0.412s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Acquiring lock "cinder-quobyte-0bfe7247-8e94-419c-944a-b3a51536435c" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:13:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Lock "cinder-quobyte-0bfe7247-8e94-419c-944a-b3a51536435c" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:13:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] snapshot: 64111c6b-278e-48d6-9b5c-00a6d3420085, volume: 0bfe7247-8e94-419c-944a-b3a51536435c, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:13:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:13:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:13:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:13:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:13:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:13:53 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd9deb4-79e3-4d86-8f34-485a14a51397]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:53 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085 Sep 01 12:13:53 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:54 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085" returned: 0 in 0.458s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:13:54 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[07904470-a119-4d7d-a507-60f7af472d90]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:13:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:54 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c Sep 01 12:13:54 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:54 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Sep 01 12:13:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c" returned: 0 in 0.852s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:13:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:13:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:13:54 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Path /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bfe7247-8e94-419c-944a-b3a51536435c not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:13:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bfe7247-8e94-419c-944a-b3a51536435c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:13:55 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bfe7247-8e94-419c-944a-b3a51536435c Sep 01 12:13:55 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:13:57 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:13:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Flow 'volume_create_manager' (93a3203e-4bf5-4066-80cc-734b2cbe61c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:13:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827ec756-bae9-412d-ad45-1d2f326f9c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827ec756-bae9-412d-ad45-1d2f326f9c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1346205720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afde052b-7c33-47ee-a4d5-b7436b8327ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6cc59d02eee4c44a156538d3b5a3cc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:57Z,use_quota=True,user_id='a90369883c3e4aa4bf86485bfaa1ec9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb330a1d-862a-4bb1-b5aa-56583f148d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb330a1d-862a-4bb1-b5aa-56583f148d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231f5c91-5e87-4e7b-9119-d9b69f75878a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231f5c91-5e87-4e7b-9119-d9b69f75878a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afde052b-7c33-47ee-a4d5-b7436b8327ad', 'volume_name': 'volume-afde052b-7c33-47ee-a4d5-b7436b8327ad', 'volume_size': 2}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc4a9415-4aab-4b39-8a41-3557c353318d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc4a9415-4aab-4b39-8a41-3557c353318d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:13:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac19105-104b-47e3-904a-593e65cfcd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:13:58 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Volume afde052b-7c33-47ee-a4d5-b7436b8327ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afde052b-7c33-47ee-a4d5-b7436b8327ad', 'volume_size': 2} Sep 01 12:13:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:02 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bfe7247-8e94-419c-944a-b3a51536435c" returned: 0 in 7.951s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:02 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c, size 1024.00 MB, duration 7.95 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bfe7247-8e94-419c-944a-b3a51536435c {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:14:02 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Converted 1024.00 MB image at 128.77 MB/s Sep 01 12:14:02 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bfe7247-8e94-419c-944a-b3a51536435c is being set with open permissions: ugo+rw Sep 01 12:14:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bfe7247-8e94-419c-944a-b3a51536435c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:02 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bfe7247-8e94-419c-944a-b3a51536435c Sep 01 12:14:02 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bfe7247-8e94-419c-944a-b3a51536435c" returned: 0 in 0.282s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Lock "cinder-quobyte-0bfe7247-8e94-419c-944a-b3a51536435c" released by "_copy_volume_from_snapshot" :: held 9.684s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Acquiring lock "cinder-quobyte-64111c6b-278e-48d6-9b5c-00a6d3420085" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:14:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Lock "cinder-quobyte-64111c6b-278e-48d6-9b5c-00a6d3420085" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:14:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Deleting offline snapshot 64111c6b-278e-48d6-9b5c-00a6d3420085 of volume 1a65d31f-779f-4baa-b8ba-6ccef0c3c65c {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:14:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] snapshot_file for this snap is: volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:14:03 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:03 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c51ec4-55f0-416f-b09a-4afb30a7b83a]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:14:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:03 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085 Sep 01 12:14:03 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:03 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085" returned: 0 in 0.509s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:14:03 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a571b2b-1a50-44aa-a504-68229393e370]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:14:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:04 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c Sep 01 12:14:04 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:04 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c" returned: 0 in 0.779s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:04 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085 Sep 01 12:14:04 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:05 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085" returned: 0 in 0.408s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:05 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085 Sep 01 12:14:05 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:05 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c.64111c6b-278e-48d6-9b5c-00a6d3420085" returned: 0 in 0.281s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Lock "cinder-quobyte-64111c6b-278e-48d6-9b5c-00a6d3420085" released by "_delete_snapshot" :: held 2.098s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.253s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.358s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1346205720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afde052b-7c33-47ee-a4d5-b7436b8327ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6cc59d02eee4c44a156538d3b5a3cc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:13:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:13:57Z,use_quota=True,user_id='a90369883c3e4aa4bf86485bfaa1ec9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:14:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Creating volume afde052b-7c33-47ee-a4d5-b7436b8327ad {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:14:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:14:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:14:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:14:05 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:14:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-afde052b-7c33-47ee-a4d5-b7436b8327ad 2147483648 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f443b7-366d-4505-b595-a109ed0bd324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bfe7247-8e94-419c-944a-b3a51536435c', 'volume_size': 1, 'source_volid': '1a65d31f-779f-4baa-b8ba-6ccef0c3c65c', 'source_volstatus': 'available'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:05 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-afde052b-7c33-47ee-a4d5-b7436b8327ad 2147483648 Sep 01 12:14:05 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1ac7c5-775a-43ee-bb11-88d118731771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:05 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Volume volume-0bfe7247-8e94-419c-944a-b3a51536435c (0bfe7247-8e94-419c-944a-b3a51536435c): created successfully Sep 01 12:14:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1ac7c5-775a-43ee-bb11-88d118731771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:05 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Flow 'volume_create_manager' (2fd327d4-3c9c-4982-a992-7cfda6e898ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:14:05 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ea0d7739-3d8f-4f84-8cce-1ba7a66af86c tempest-VolumesGetTest-73630739 None] Created volume successfully. Sep 01 12:14:05 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-afde052b-7c33-47ee-a4d5-b7436b8327ad 2147483648" returned: 0 in 0.503s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-afde052b-7c33-47ee-a4d5-b7436b8327ad {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:06 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-afde052b-7c33-47ee-a4d5-b7436b8327ad Sep 01 12:14:06 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:06 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-afde052b-7c33-47ee-a4d5-b7436b8327ad" returned: 0 in 0.253s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:14:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac19105-104b-47e3-904a-593e65cfcd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afde052b-7c33-47ee-a4d5-b7436b8327ad', 'volume_size': 2}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c02a94d-5286-4a91-9448-875bf1a1fc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:06 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Volume volume-afde052b-7c33-47ee-a4d5-b7436b8327ad (afde052b-7c33-47ee-a4d5-b7436b8327ad): created successfully Sep 01 12:14:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c02a94d-5286-4a91-9448-875bf1a1fc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Flow 'volume_create_manager' (93a3203e-4bf5-4066-80cc-734b2cbe61c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:14:06 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c34dc090-1770-49ab-8d3e-b42783ad7372 tempest-VolumesCloneNegativeTest-463122868 None] Created volume successfully. Sep 01 12:14:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5f09e0fe-a0c4-4778-acb1-32b108f9aee9 tempest-VolumesCloneNegativeTest-463122868 None] Acquiring lock "cinder-afde052b-7c33-47ee-a4d5-b7436b8327ad-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:14:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5f09e0fe-a0c4-4778-acb1-32b108f9aee9 tempest-VolumesCloneNegativeTest-463122868 None] Lock "cinder-afde052b-7c33-47ee-a4d5-b7436b8327ad-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:14:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5f09e0fe-a0c4-4778-acb1-32b108f9aee9 tempest-VolumesCloneNegativeTest-463122868 None] Acquiring lock "cinder-quobyte-afde052b-7c33-47ee-a4d5-b7436b8327ad" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5f09e0fe-a0c4-4778-acb1-32b108f9aee9 tempest-VolumesCloneNegativeTest-463122868 None] Lock "cinder-quobyte-afde052b-7c33-47ee-a4d5-b7436b8327ad" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cca2560-6cfb-44fa-aa7c-0bd7bf769ad8]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5f09e0fe-a0c4-4778-acb1-32b108f9aee9 tempest-VolumesCloneNegativeTest-463122868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-afde052b-7c33-47ee-a4d5-b7436b8327ad {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:07 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-afde052b-7c33-47ee-a4d5-b7436b8327ad Sep 01 12:14:07 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:07 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5f09e0fe-a0c4-4778-acb1-32b108f9aee9 tempest-VolumesCloneNegativeTest-463122868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-afde052b-7c33-47ee-a4d5-b7436b8327ad" returned: 0 in 0.501s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5f09e0fe-a0c4-4778-acb1-32b108f9aee9 tempest-VolumesCloneNegativeTest-463122868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-afde052b-7c33-47ee-a4d5-b7436b8327ad {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:07 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-afde052b-7c33-47ee-a4d5-b7436b8327ad Sep 01 12:14:07 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Flow 'volume_create_manager' (e75356dc-3b93-4731-83e8-3e1a44cab59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6de27e-15b3-4e30-b8b4-364225f6f981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6de27e-15b3-4e30-b8b4-364225f6f981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:14:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-122618501',display_name='tempest-VolumesGetTest-Volume-1810917772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075cfe98-2888-4116-a395-91d7d57c1e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645e221d3e9f4446931a48ea2539d472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:14:08Z,use_quota=True,user_id='a75d133e057e4151a23843d4742a9da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0aa333f-dfef-4c9c-9e63-0a4b55bb5cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0aa333f-dfef-4c9c-9e63-0a4b55bb5cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c315f638-1ce9-4a9e-981c-7a72d2a0892c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c315f638-1ce9-4a9e-981c-7a72d2a0892c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '075cfe98-2888-4116-a395-91d7d57c1e6a', 'volume_name': 'volume-075cfe98-2888-4116-a395-91d7d57c1e6a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390226c2-ab88-4009-b91c-00741ead8737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390226c2-ab88-4009-b91c-00741ead8737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff50dd76-3412-4538-a753-ae3a8c9f62ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:07 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Volume 075cfe98-2888-4116-a395-91d7d57c1e6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-075cfe98-2888-4116-a395-91d7d57c1e6a', 'volume_size': 1} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:14:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-122618501',display_name='tempest-VolumesGetTest-Volume-1810917772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075cfe98-2888-4116-a395-91d7d57c1e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645e221d3e9f4446931a48ea2539d472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:14:08Z,use_quota=True,user_id='a75d133e057e4151a23843d4742a9da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Creating volume 075cfe98-2888-4116-a395-91d7d57c1e6a {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:14:07 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-075cfe98-2888-4116-a395-91d7d57c1e6a 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:07 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-075cfe98-2888-4116-a395-91d7d57c1e6a 1073741824 Sep 01 12:14:07 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:07 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5f09e0fe-a0c4-4778-acb1-32b108f9aee9 tempest-VolumesCloneNegativeTest-463122868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-afde052b-7c33-47ee-a4d5-b7436b8327ad" returned: 0 in 0.427s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5f09e0fe-a0c4-4778-acb1-32b108f9aee9 tempest-VolumesCloneNegativeTest-463122868 None] Lock "cinder-quobyte-afde052b-7c33-47ee-a4d5-b7436b8327ad" released by "delete_volume" :: held 1.000s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:08 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-5f09e0fe-a0c4-4778-acb1-32b108f9aee9 tempest-VolumesCloneNegativeTest-463122868 None] Created reservations ['4184ceac-46ea-4655-a1f7-558c4e125856', '555b08d9-e120-4ba7-8d71-445e08e602ec', '667d2e7a-3ece-44dd-b9b2-aec131cbca76', 'b3752073-8409-44af-a635-656af7eb23c3'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:14:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5f09e0fe-a0c4-4778-acb1-32b108f9aee9 tempest-VolumesCloneNegativeTest-463122868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5f09e0fe-a0c4-4778-acb1-32b108f9aee9 tempest-VolumesCloneNegativeTest-463122868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5f09e0fe-a0c4-4778-acb1-32b108f9aee9 tempest-VolumesCloneNegativeTest-463122868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:14:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5f09e0fe-a0c4-4778-acb1-32b108f9aee9 tempest-VolumesCloneNegativeTest-463122868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:14:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5f09e0fe-a0c4-4778-acb1-32b108f9aee9 tempest-VolumesCloneNegativeTest-463122868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5f09e0fe-a0c4-4778-acb1-32b108f9aee9 tempest-VolumesCloneNegativeTest-463122868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:08 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:14:08 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:08 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-075cfe98-2888-4116-a395-91d7d57c1e6a 1073741824" returned: 0 in 0.631s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-075cfe98-2888-4116-a395-91d7d57c1e6a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:08 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-075cfe98-2888-4116-a395-91d7d57c1e6a Sep 01 12:14:08 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:08 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5f09e0fe-a0c4-4778-acb1-32b108f9aee9 tempest-VolumesCloneNegativeTest-463122868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.322s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:08 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-5f09e0fe-a0c4-4778-acb1-32b108f9aee9 tempest-VolumesCloneNegativeTest-463122868 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:14:08 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5f09e0fe-a0c4-4778-acb1-32b108f9aee9 tempest-VolumesCloneNegativeTest-463122868 None] Deleted volume successfully. Sep 01 12:14:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5f09e0fe-a0c4-4778-acb1-32b108f9aee9 tempest-VolumesCloneNegativeTest-463122868 None] Lock "cinder-afde052b-7c33-47ee-a4d5-b7436b8327ad-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:08 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-075cfe98-2888-4116-a395-91d7d57c1e6a" returned: 0 in 0.295s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:14:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff50dd76-3412-4538-a753-ae3a8c9f62ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-075cfe98-2888-4116-a395-91d7d57c1e6a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5e8d94-24e3-466d-9196-39afa9b583d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:08 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Volume volume-075cfe98-2888-4116-a395-91d7d57c1e6a (075cfe98-2888-4116-a395-91d7d57c1e6a): created successfully Sep 01 12:14:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5e8d94-24e3-466d-9196-39afa9b583d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Flow 'volume_create_manager' (e75356dc-3b93-4731-83e8-3e1a44cab59e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:14:08 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-26be78c0-a05d-4106-b871-343655318099 tempest-VolumesGetTest-73630739 None] Created volume successfully. Sep 01 12:14:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dd47f919-642c-4673-9598-7a787f291dfd tempest-VolumesGetTest-73630739 None] Acquiring lock "cinder-075cfe98-2888-4116-a395-91d7d57c1e6a-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:14:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dd47f919-642c-4673-9598-7a787f291dfd tempest-VolumesGetTest-73630739 None] Lock "cinder-075cfe98-2888-4116-a395-91d7d57c1e6a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:14:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dd47f919-642c-4673-9598-7a787f291dfd tempest-VolumesGetTest-73630739 None] Acquiring lock "cinder-quobyte-075cfe98-2888-4116-a395-91d7d57c1e6a" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:14:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dd47f919-642c-4673-9598-7a787f291dfd tempest-VolumesGetTest-73630739 None] Lock "cinder-quobyte-075cfe98-2888-4116-a395-91d7d57c1e6a" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:14:10 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a4b380-9369-4564-948e-8ffa3c0a21cc]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:14:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dd47f919-642c-4673-9598-7a787f291dfd tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-075cfe98-2888-4116-a395-91d7d57c1e6a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:10 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-075cfe98-2888-4116-a395-91d7d57c1e6a Sep 01 12:14:10 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:11 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dd47f919-642c-4673-9598-7a787f291dfd tempest-VolumesGetTest-73630739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-075cfe98-2888-4116-a395-91d7d57c1e6a" returned: 0 in 0.627s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dd47f919-642c-4673-9598-7a787f291dfd tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-075cfe98-2888-4116-a395-91d7d57c1e6a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:11 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-075cfe98-2888-4116-a395-91d7d57c1e6a Sep 01 12:14:11 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:11 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dd47f919-642c-4673-9598-7a787f291dfd tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-075cfe98-2888-4116-a395-91d7d57c1e6a" returned: 0 in 0.450s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dd47f919-642c-4673-9598-7a787f291dfd tempest-VolumesGetTest-73630739 None] Lock "cinder-quobyte-075cfe98-2888-4116-a395-91d7d57c1e6a" released by "delete_volume" :: held 1.207s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:11 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-dd47f919-642c-4673-9598-7a787f291dfd tempest-VolumesGetTest-73630739 None] Created reservations ['1eb46008-d88c-47dc-b3ad-68b3f380d241', 'aba34f10-963b-4514-a860-3a11aa63cb32', '2c5fa754-53f2-48ee-9fce-7c50f5f316ab', 'fe467aa8-300d-4e08-b960-f1faaef56687'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:14:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dd47f919-642c-4673-9598-7a787f291dfd tempest-VolumesGetTest-73630739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dd47f919-642c-4673-9598-7a787f291dfd tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-dd47f919-642c-4673-9598-7a787f291dfd tempest-VolumesGetTest-73630739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:14:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-dd47f919-642c-4673-9598-7a787f291dfd tempest-VolumesGetTest-73630739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:14:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-dd47f919-642c-4673-9598-7a787f291dfd tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dd47f919-642c-4673-9598-7a787f291dfd tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:11 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:14:11 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:12 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dd47f919-642c-4673-9598-7a787f291dfd tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.361s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:12 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-dd47f919-642c-4673-9598-7a787f291dfd tempest-VolumesGetTest-73630739 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:14:12 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-dd47f919-642c-4673-9598-7a787f291dfd tempest-VolumesGetTest-73630739 None] Deleted volume successfully. Sep 01 12:14:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dd47f919-642c-4673-9598-7a787f291dfd tempest-VolumesGetTest-73630739 None] Lock "cinder-075cfe98-2888-4116-a395-91d7d57c1e6a-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7168807c-56ff-4d9b-bed3-194305984225 tempest-VolumesGetTest-73630739 None] Acquiring lock "cinder-0bfe7247-8e94-419c-944a-b3a51536435c-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:14:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7168807c-56ff-4d9b-bed3-194305984225 tempest-VolumesGetTest-73630739 None] Lock "cinder-0bfe7247-8e94-419c-944a-b3a51536435c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:14:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7168807c-56ff-4d9b-bed3-194305984225 tempest-VolumesGetTest-73630739 None] Acquiring lock "cinder-quobyte-0bfe7247-8e94-419c-944a-b3a51536435c" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:14:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7168807c-56ff-4d9b-bed3-194305984225 tempest-VolumesGetTest-73630739 None] Lock "cinder-quobyte-0bfe7247-8e94-419c-944a-b3a51536435c" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:14:12 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ab9b89-22cb-4bf8-8719-89fc727d44d6]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:14:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7168807c-56ff-4d9b-bed3-194305984225 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bfe7247-8e94-419c-944a-b3a51536435c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:12 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bfe7247-8e94-419c-944a-b3a51536435c Sep 01 12:14:12 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:13 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7168807c-56ff-4d9b-bed3-194305984225 tempest-VolumesGetTest-73630739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bfe7247-8e94-419c-944a-b3a51536435c" returned: 0 in 0.490s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7168807c-56ff-4d9b-bed3-194305984225 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bfe7247-8e94-419c-944a-b3a51536435c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:13 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bfe7247-8e94-419c-944a-b3a51536435c Sep 01 12:14:13 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:13 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7168807c-56ff-4d9b-bed3-194305984225 tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0bfe7247-8e94-419c-944a-b3a51536435c" returned: 0 in 0.266s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7168807c-56ff-4d9b-bed3-194305984225 tempest-VolumesGetTest-73630739 None] Lock "cinder-quobyte-0bfe7247-8e94-419c-944a-b3a51536435c" released by "delete_volume" :: held 0.817s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:13 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-7168807c-56ff-4d9b-bed3-194305984225 tempest-VolumesGetTest-73630739 None] Created reservations ['d8581061-fad7-4da6-8db0-ec3877165ec9', '863df925-7265-4a28-874e-eb758d27ab26', '9e0bf3be-2f6a-40bb-8fe2-b41ad34553e8', '2d18e3a1-4719-4d7a-95fd-fe9552aa083f'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:14:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7168807c-56ff-4d9b-bed3-194305984225 tempest-VolumesGetTest-73630739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7168807c-56ff-4d9b-bed3-194305984225 tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7168807c-56ff-4d9b-bed3-194305984225 tempest-VolumesGetTest-73630739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:14:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7168807c-56ff-4d9b-bed3-194305984225 tempest-VolumesGetTest-73630739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:14:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7168807c-56ff-4d9b-bed3-194305984225 tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7168807c-56ff-4d9b-bed3-194305984225 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:13 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:14:13 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:13 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:14:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Flow 'volume_create_manager' (af65d942-b6e2-4705-be8a-2c4ab11f8dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:14:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f7ebdd-efcf-4b15-ba79-e3d0d4af2bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c9254c12-b956-495e-af3f-34d41ccda26e tempest-VolumesGetTest-73630739 None] Acquiring lock "cinder-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:14:13 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f7ebdd-efcf-4b15-ba79-e3d0d4af2bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1412990599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab3939d-2fbb-4ee5-b379-db43e7bc7b29,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1172a17dc484f35b0149ae0e1c32119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:14:14Z,use_quota=True,user_id='b15efbe8ee3544eda1a080b128563723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63832bf-e5b5-469e-93ee-941f3c19b0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63832bf-e5b5-469e-93ee-941f3c19b0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ad5ec15-68b9-4aa2-a7b2-2fa28686bc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ad5ec15-68b9-4aa2-a7b2-2fa28686bc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ab3939d-2fbb-4ee5-b379-db43e7bc7b29', 'volume_name': 'volume-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ef284f-4721-4c1b-99a1-a769784909a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ef284f-4721-4c1b-99a1-a769784909a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d3fd55-2609-4dfa-ae17-8c16c6a81b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:14 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Volume 8ab3939d-2fbb-4ee5-b379-db43e7bc7b29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29', 'volume_size': 1} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1412990599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab3939d-2fbb-4ee5-b379-db43e7bc7b29,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1172a17dc484f35b0149ae0e1c32119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:14:14Z,use_quota=True,user_id='b15efbe8ee3544eda1a080b128563723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Creating volume 8ab3939d-2fbb-4ee5-b379-db43e7bc7b29 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:14:14 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7168807c-56ff-4d9b-bed3-194305984225 tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.334s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-7168807c-56ff-4d9b-bed3-194305984225 tempest-VolumesGetTest-73630739 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:14:14 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7168807c-56ff-4d9b-bed3-194305984225 tempest-VolumesGetTest-73630739 None] Deleted volume successfully. Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c9254c12-b956-495e-af3f-34d41ccda26e tempest-VolumesGetTest-73630739 None] Lock "cinder-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:14:14 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29 1073741824 Sep 01 12:14:14 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7168807c-56ff-4d9b-bed3-194305984225 tempest-VolumesGetTest-73630739 None] Lock "cinder-0bfe7247-8e94-419c-944a-b3a51536435c-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c9254c12-b956-495e-af3f-34d41ccda26e tempest-VolumesGetTest-73630739 None] Acquiring lock "cinder-quobyte-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c9254c12-b956-495e-af3f-34d41ccda26e tempest-VolumesGetTest-73630739 None] Lock "cinder-quobyte-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c" acquired by "delete_volume" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0cb2cc-424a-48c2-ba03-200e8510e484]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c9254c12-b956-495e-af3f-34d41ccda26e tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:14 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c Sep 01 12:14:14 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:14 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29 1073741824" returned: 0 in 0.536s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:14 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c9254c12-b956-495e-af3f-34d41ccda26e tempest-VolumesGetTest-73630739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c" returned: 0 in 0.401s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c9254c12-b956-495e-af3f-34d41ccda26e tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:14 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c Sep 01 12:14:14 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:14 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29 Sep 01 12:14:14 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:14 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c9254c12-b956-495e-af3f-34d41ccda26e tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c" returned: 0 in 0.257s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c9254c12-b956-495e-af3f-34d41ccda26e tempest-VolumesGetTest-73630739 None] Lock "cinder-quobyte-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c" released by "delete_volume" :: held 0.747s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:14 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29" returned: 0 in 0.279s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d3fd55-2609-4dfa-ae17-8c16c6a81b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6b4071-a7e3-4775-aecb-e656f6308027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c9254c12-b956-495e-af3f-34d41ccda26e tempest-VolumesGetTest-73630739 None] Created reservations ['30744e1e-0221-4720-94f7-cee1954561d9', '49c02511-c212-4f47-a82a-003beb5df7d6', '5f97657d-2520-4264-8160-c0898182199a', '9392abd6-8ffd-4772-88f0-c4d42b8d0cb4'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:14:14 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Volume volume-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29 (8ab3939d-2fbb-4ee5-b379-db43e7bc7b29): created successfully Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6b4071-a7e3-4775-aecb-e656f6308027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Flow 'volume_create_manager' (af65d942-b6e2-4705-be8a-2c4ab11f8dca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:14:14 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-340ae61c-f24a-4c3a-aed2-2035a7d3c775 tempest-VolumesListTestJSON-1980068411 None] Created volume successfully. Sep 01 12:14:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c9254c12-b956-495e-af3f-34d41ccda26e tempest-VolumesGetTest-73630739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c9254c12-b956-495e-af3f-34d41ccda26e tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c9254c12-b956-495e-af3f-34d41ccda26e tempest-VolumesGetTest-73630739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:14:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c9254c12-b956-495e-af3f-34d41ccda26e tempest-VolumesGetTest-73630739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:14:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c9254c12-b956-495e-af3f-34d41ccda26e tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c9254c12-b956-495e-af3f-34d41ccda26e tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:15 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:14:15 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:15 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c9254c12-b956-495e-af3f-34d41ccda26e tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.278s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:15 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c9254c12-b956-495e-af3f-34d41ccda26e tempest-VolumesGetTest-73630739 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:14:15 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c9254c12-b956-495e-af3f-34d41ccda26e tempest-VolumesGetTest-73630739 None] Deleted volume successfully. Sep 01 12:14:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c9254c12-b956-495e-af3f-34d41ccda26e tempest-VolumesGetTest-73630739 None] Lock "cinder-1a65d31f-779f-4baa-b8ba-6ccef0c3c65c-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:15 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:14:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Flow 'volume_create_manager' (06717cd8-215b-4cc5-8d7c-21637624485f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:14:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd85069-0837-49b8-b9cc-0a1a211f9092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd85069-0837-49b8-b9cc-0a1a211f9092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1918106563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ba23c1-a24b-4558-a718-1e1f08ac800f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='645e221d3e9f4446931a48ea2539d472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:14:16Z,use_quota=True,user_id='a75d133e057e4151a23843d4742a9da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcec64f-2e83-4b2e-bad3-4ba831a769c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcec64f-2e83-4b2e-bad3-4ba831a769c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd8042f-cf73-4cf3-8430-0add667eb39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:15 devstack cinder-volume[87084]: DEBUG cinder.image.glance [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Creating Keystone auth plugin from conf {{(pid=87084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 12:14:15 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-abdd6950-23fe-432c-9cf9-c47e2b3fa722 req-e3a8bb91-33ab-4d77-b0f9-5c0ab846bbb8 tempest-AttachVolumeNegativeTest-36464837 None] Terminate volume connection completed successfully. Sep 01 12:14:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-abdd6950-23fe-432c-9cf9-c47e2b3fa722 req-e3a8bb91-33ab-4d77-b0f9-5c0ab846bbb8 tempest-AttachVolumeNegativeTest-36464837 None] Deleting attachment a930ca1e-8d10-4b1a-bfde-d0bf6205c58e. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd8042f-cf73-4cf3-8430-0add667eb39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b0ba23c1-a24b-4558-a718-1e1f08ac800f', 'volume_name': 'volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f', 'volume_size': 1, 'image_id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42fce3cc35724a058187a1135a373ea9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'created_at': datetime.datetime(2026, 9, 1, 9, 59, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 59, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (283ced6a-47f1-4512-9ded-4f4cc9c419b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (283ced6a-47f1-4512-9ded-4f4cc9c419b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2532d194-da26-4cdc-a3fa-55f88b271b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:16 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Volume b0ba23c1-a24b-4558-a718-1e1f08ac800f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f', 'volume_size': 1, 'image_id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42fce3cc35724a058187a1135a373ea9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'created_at': datetime.datetime(2026, 9, 1, 9, 59, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 59, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Trying to clone b0ba23c1-a24b-4558-a718-1e1f08ac800f from image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}]). {{(pid=87084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Flow 'volume_create_manager' (8e697e7d-262c-4e40-bd9a-afe4201b9ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f15f95d-d92d-4fee-aea1-2f458b8bebfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f15f95d-d92d-4fee-aea1-2f458b8bebfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-880922725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f69cb6-50d2-4011-883a-d79e3a34a301,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1172a17dc484f35b0149ae0e1c32119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:14:17Z,use_quota=True,user_id='b15efbe8ee3544eda1a080b128563723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f1430b-e98a-4c86-b303-a32a8a8068cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f1430b-e98a-4c86-b303-a32a8a8068cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beaa8d83-805c-4d30-8883-3fc6c1bfe8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beaa8d83-805c-4d30-8883-3fc6c1bfe8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43f69cb6-50d2-4011-883a-d79e3a34a301', 'volume_name': 'volume-43f69cb6-50d2-4011-883a-d79e3a34a301', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0842698b-44ef-4f31-a39d-a2e87aaa0851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0842698b-44ef-4f31-a39d-a2e87aaa0851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e66d4a2b-3f1f-4dfc-a20d-6746d7a9a0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:16 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Volume 43f69cb6-50d2-4011-883a-d79e3a34a301: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43f69cb6-50d2-4011-883a-d79e3a34a301', 'volume_size': 1} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-880922725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f69cb6-50d2-4011-883a-d79e3a34a301,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1172a17dc484f35b0149ae0e1c32119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:14:17Z,use_quota=True,user_id='b15efbe8ee3544eda1a080b128563723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Creating volume 43f69cb6-50d2-4011-883a-d79e3a34a301 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:14:16 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-43f69cb6-50d2-4011-883a-d79e3a34a301 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:16 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-43f69cb6-50d2-4011-883a-d79e3a34a301 1073741824 Sep 01 12:14:16 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:16 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lbubqblbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 12:14:16 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Image download 20.69 MB at 20.69 MB/s Sep 01 12:14:17 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6371e48-1978-4bd7-939d-bba3f572c510]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:14:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lbubqblbdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:17 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lbubqblbdevstack@QuobyteHD Sep 01 12:14:17 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:17 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lbubqblbdevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:17 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Temporary image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c is fetched for user a75d133e057e4151a23843d4742a9da8. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 12:14:17 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-43f69cb6-50d2-4011-883a-d79e3a34a301 1073741824" returned: 0 in 0.823s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:17 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2e2147-79af-470c-97e2-5c3ac325ed20]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:14:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lbubqblbdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-43f69cb6-50d2-4011-883a-d79e3a34a301 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:17 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-43f69cb6-50d2-4011-883a-d79e3a34a301 Sep 01 12:14:17 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:17 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lbubqblbdevstack@QuobyteHD Sep 01 12:14:17 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:17 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-43f69cb6-50d2-4011-883a-d79e3a34a301" returned: 0 in 0.361s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:14:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e66d4a2b-3f1f-4dfc-a20d-6746d7a9a0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43f69cb6-50d2-4011-883a-d79e3a34a301', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728c05fd-a316-4ff6-b543-12a037175fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:18 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Volume volume-43f69cb6-50d2-4011-883a-d79e3a34a301 (43f69cb6-50d2-4011-883a-d79e3a34a301): created successfully Sep 01 12:14:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728c05fd-a316-4ff6-b543-12a037175fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Flow 'volume_create_manager' (8e697e7d-262c-4e40-bd9a-afe4201b9ed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:14:18 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-31418752-191d-4fe9-b14a-9c65df7257c1 tempest-VolumesListTestJSON-1980068411 None] Created volume successfully. Sep 01 12:14:18 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lbubqblbdevstack@QuobyteHD" returned: 0 in 0.495s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1918106563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ba23c1-a24b-4558-a718-1e1f08ac800f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='645e221d3e9f4446931a48ea2539d472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:14:16Z,use_quota=True,user_id='a75d133e057e4151a23843d4742a9da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:14:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Creating volume b0ba23c1-a24b-4558-a718-1e1f08ac800f {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:14:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:14:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:14:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:14:18 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:14:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:18 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f 1073741824 Sep 01 12:14:18 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:18 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f 1073741824" returned: 0 in 0.630s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:18 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f Sep 01 12:14:18 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:19 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f" returned: 0 in 0.394s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Attempting download of 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c ((None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}])) to volume b0ba23c1-a24b-4558-a718-1e1f08ac800f. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[76171db6-e796-47bd-8af4-da334372b891]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_y9_p2svz {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:19 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_y9_p2svz Sep 01 12:14:19 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Flow 'volume_create_manager' (9983e7bb-59ac-4ab3-9489-930f0e4c2987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4804cd-dfa8-4ee7-a5b4-3b5630cc147c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4804cd-dfa8-4ee7-a5b4-3b5630cc147c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2040732153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd56f0a-1a0f-43cf-a4f7-7250ee689b08,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1172a17dc484f35b0149ae0e1c32119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:14:20Z,use_quota=True,user_id='b15efbe8ee3544eda1a080b128563723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6314ac77-38cc-4911-8407-62c3ee450667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6314ac77-38cc-4911-8407-62c3ee450667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65bdce66-192f-41e9-8fe1-82202cfd3901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65bdce66-192f-41e9-8fe1-82202cfd3901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecd56f0a-1a0f-43cf-a4f7-7250ee689b08', 'volume_name': 'volume-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b36c4a1-b264-47c4-ba70-107f614c6d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b36c4a1-b264-47c4-ba70-107f614c6d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ac3307-0cb0-4700-865f-82d739413422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:19 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Volume ecd56f0a-1a0f-43cf-a4f7-7250ee689b08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08', 'volume_size': 1} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2040732153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd56f0a-1a0f-43cf-a4f7-7250ee689b08,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1172a17dc484f35b0149ae0e1c32119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:14:20Z,use_quota=True,user_id='b15efbe8ee3544eda1a080b128563723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Creating volume ecd56f0a-1a0f-43cf-a4f7-7250ee689b08 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:14:19 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:19 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08 1073741824 Sep 01 12:14:19 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:19 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_y9_p2svz" returned: 0 in 0.480s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_y9_p2svz {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:19 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_y9_p2svz Sep 01 12:14:19 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:20 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_y9_p2svz" returned: 1 in 0.362s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_y9_p2svz' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:14:20 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb063dba-be94-4cae-812f-d7e52f6ae72d]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:14:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lbubqblbdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:20 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lbubqblbdevstack@QuobyteHD Sep 01 12:14:20 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:20 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08 1073741824" returned: 0 in 0.682s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:20 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08 Sep 01 12:14:20 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:20 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lbubqblbdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:20 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c was qcow2, converting to qcow2 {{(pid=87084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 12:14:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lbubqblbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:20 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lbubqblbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f Sep 01 12:14:20 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:20 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08" returned: 0 in 0.282s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:14:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ac3307-0cb0-4700-865f-82d739413422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dfd1ae1-c132-49d1-a1b3-c75a67db0251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:20 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Volume volume-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08 (ecd56f0a-1a0f-43cf-a4f7-7250ee689b08): created successfully Sep 01 12:14:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dfd1ae1-c132-49d1-a1b3-c75a67db0251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Flow 'volume_create_manager' (9983e7bb-59ac-4ab3-9489-930f0e4c2987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:14:20 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a3f30259-23b2-4407-b0ec-28c3eb1666c7 tempest-VolumesListTestJSON-1980068411 None] Created volume successfully. Sep 01 12:14:22 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lbubqblbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f" returned: 0 in 2.074s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:22 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lbubqblbdevstack@QuobyteHD, size 112.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:14:22 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Converted 112.00 MB image at 53.98 MB/s Sep 01 12:14:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:22 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f 1G Sep 01 12:14:22 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:23 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f 1G" returned: 0 in 0.395s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:23 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Downloaded image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c ((None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}])) to volume b0ba23c1-a24b-4558-a718-1e1f08ac800f successfully. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 12:14:23 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Temporary image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c for user a75d133e057e4151a23843d4742a9da8 is deleted. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 12:14:23 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Marking volume b0ba23c1-a24b-4558-a718-1e1f08ac800f as bootable. {{(pid=87084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 12:14:23 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Copying metadata from image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c to b0ba23c1-a24b-4558-a718-1e1f08ac800f. {{(pid=87084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 12:14:23 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Creating volume glance metadata for volume b0ba23c1-a24b-4558-a718-1e1f08ac800f backed by image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 12:14:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2532d194-da26-4cdc-a3fa-55f88b271b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f', 'volume_size': 1, 'image_id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42fce3cc35724a058187a1135a373ea9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'created_at': datetime.datetime(2026, 9, 1, 9, 59, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 59, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd93154c-a855-4e17-9bc0-a0b7a7ea729b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:23 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Volume volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f (b0ba23c1-a24b-4558-a718-1e1f08ac800f): created successfully Sep 01 12:14:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd93154c-a855-4e17-9bc0-a0b7a7ea729b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Flow 'volume_create_manager' (06717cd8-215b-4cc5-8d7c-21637624485f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:14:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2df564d9-2325-423d-bca0-cde7b79fc453 tempest-VolumesGetTest-73630739 None] Created volume successfully. Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Flow 'volume_create_manager' (eefb7099-c805-41dc-879e-1556b66a53a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fae90a5-a59f-457f-81b0-172cca6ed68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fae90a5-a59f-457f-81b0-172cca6ed68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:14:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2142938355',display_name='tempest-VolumesGetTest-Volume-1173582745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f49b168-b6ee-4f89-9305-b6df3675f080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645e221d3e9f4446931a48ea2539d472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:14:24Z,use_quota=True,user_id='a75d133e057e4151a23843d4742a9da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ab3c2e-bfde-4e35-8dae-119c41c18ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ab3c2e-bfde-4e35-8dae-119c41c18ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3be3a8a-4665-4ab9-86f8-00fc06c5d8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3be3a8a-4665-4ab9-86f8-00fc06c5d8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f49b168-b6ee-4f89-9305-b6df3675f080', 'volume_name': 'volume-5f49b168-b6ee-4f89-9305-b6df3675f080', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea1f6fd-3832-452c-b579-d68a7b242a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea1f6fd-3832-452c-b579-d68a7b242a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e13d07-99dd-4239-84d3-030761d5cce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:24 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Volume 5f49b168-b6ee-4f89-9305-b6df3675f080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f49b168-b6ee-4f89-9305-b6df3675f080', 'volume_size': 1} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:14:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2142938355',display_name='tempest-VolumesGetTest-Volume-1173582745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f49b168-b6ee-4f89-9305-b6df3675f080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645e221d3e9f4446931a48ea2539d472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:14:24Z,use_quota=True,user_id='a75d133e057e4151a23843d4742a9da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Creating volume 5f49b168-b6ee-4f89-9305-b6df3675f080 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:14:24 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f49b168-b6ee-4f89-9305-b6df3675f080 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:24 devstack sudo[97025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f49b168-b6ee-4f89-9305-b6df3675f080 1073741824 Sep 01 12:14:24 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b858e2db-c041-45b0-908a-d8a6c159e698 tempest-VolumesListTestJSON-1980068411 None] Acquiring lock "cinder-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b858e2db-c041-45b0-908a-d8a6c159e698 tempest-VolumesListTestJSON-1980068411 None] Lock "cinder-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b858e2db-c041-45b0-908a-d8a6c159e698 tempest-VolumesListTestJSON-1980068411 None] Acquiring lock "cinder-quobyte-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b858e2db-c041-45b0-908a-d8a6c159e698 tempest-VolumesListTestJSON-1980068411 None] Lock "cinder-quobyte-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08" acquired by "delete_volume" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adfbd19-b6c9-4c44-8d6f-2c1f091ef50e]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:14:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b858e2db-c041-45b0-908a-d8a6c159e698 tempest-VolumesListTestJSON-1980068411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:25 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08 Sep 01 12:14:25 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Flow 'volume_create_manager' (df59e390-f5c7-4cb3-b48b-e49125d2a3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:14:25 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0cf2d5-bc09-4993-b068-0e23ec30ed25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f49b168-b6ee-4f89-9305-b6df3675f080 1073741824" returned: 0 in 0.720s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0cf2d5-bc09-4993-b068-0e23ec30ed25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1086526738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f105f57-73da-42ff-9589-c5e6a8d4e6de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c016019f29349f79cd93957de8a9337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:14:25Z,use_quota=True,user_id='82fb76bee8404d3e95228ce81c25351c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b205c273-1656-4f2e-9f28-2317d47e2829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b205c273-1656-4f2e-9f28-2317d47e2829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f31f9e2-9d69-4e53-9c16-58d4f579a691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f31f9e2-9d69-4e53-9c16-58d4f579a691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f105f57-73da-42ff-9589-c5e6a8d4e6de', 'volume_name': 'volume-7f105f57-73da-42ff-9589-c5e6a8d4e6de', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6deb7a11-71f8-4bb8-9c8f-f93a5857d447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6deb7a11-71f8-4bb8-9c8f-f93a5857d447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ca0a9a-4554-4b74-bc85-a1d495d09bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:25 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Volume 7f105f57-73da-42ff-9589-c5e6a8d4e6de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f105f57-73da-42ff-9589-c5e6a8d4e6de', 'volume_size': 1} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:25 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b858e2db-c041-45b0-908a-d8a6c159e698 tempest-VolumesListTestJSON-1980068411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08" returned: 0 in 0.454s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b858e2db-c041-45b0-908a-d8a6c159e698 tempest-VolumesListTestJSON-1980068411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f49b168-b6ee-4f89-9305-b6df3675f080 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:25 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08 Sep 01 12:14:25 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:25 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f49b168-b6ee-4f89-9305-b6df3675f080 Sep 01 12:14:25 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:25 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b858e2db-c041-45b0-908a-d8a6c159e698 tempest-VolumesListTestJSON-1980068411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08" returned: 0 in 0.253s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b858e2db-c041-45b0-908a-d8a6c159e698 tempest-VolumesListTestJSON-1980068411 None] Lock "cinder-quobyte-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08" released by "delete_volume" :: held 0.797s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:25 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f49b168-b6ee-4f89-9305-b6df3675f080" returned: 0 in 0.325s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.397s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1086526738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f105f57-73da-42ff-9589-c5e6a8d4e6de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c016019f29349f79cd93957de8a9337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:14:25Z,use_quota=True,user_id='82fb76bee8404d3e95228ce81c25351c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Creating volume 7f105f57-73da-42ff-9589-c5e6a8d4e6de {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:14:25 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7f105f57-73da-42ff-9589-c5e6a8d4e6de 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:25 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7f105f57-73da-42ff-9589-c5e6a8d4e6de 1073741824 Sep 01 12:14:25 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e13d07-99dd-4239-84d3-030761d5cce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f49b168-b6ee-4f89-9305-b6df3675f080', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d660be3-7b24-4419-bd7d-ff58a6c39a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-b858e2db-c041-45b0-908a-d8a6c159e698 tempest-VolumesListTestJSON-1980068411 None] Created reservations ['404cb15c-cfdb-42a4-abea-62c76f309035', '3358863c-d58d-485e-88af-c20cd69da8d8', 'ac5b6945-b9da-44a4-8a23-3c9a24a6f344', '340c8fa2-5a8a-4901-a1af-b176e6d15361'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:14:25 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Volume volume-5f49b168-b6ee-4f89-9305-b6df3675f080 (5f49b168-b6ee-4f89-9305-b6df3675f080): created successfully Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d660be3-7b24-4419-bd7d-ff58a6c39a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Flow 'volume_create_manager' (eefb7099-c805-41dc-879e-1556b66a53a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:14:25 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-be9a2e9d-035c-4673-99b0-02c897eb9b5a tempest-VolumesGetTest-73630739 None] Created volume successfully. Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b858e2db-c041-45b0-908a-d8a6c159e698 tempest-VolumesListTestJSON-1980068411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b858e2db-c041-45b0-908a-d8a6c159e698 tempest-VolumesListTestJSON-1980068411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b858e2db-c041-45b0-908a-d8a6c159e698 tempest-VolumesListTestJSON-1980068411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b858e2db-c041-45b0-908a-d8a6c159e698 tempest-VolumesListTestJSON-1980068411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b858e2db-c041-45b0-908a-d8a6c159e698 tempest-VolumesListTestJSON-1980068411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b858e2db-c041-45b0-908a-d8a6c159e698 tempest-VolumesListTestJSON-1980068411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:25 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:14:25 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:26 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b858e2db-c041-45b0-908a-d8a6c159e698 tempest-VolumesListTestJSON-1980068411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.283s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:26 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b858e2db-c041-45b0-908a-d8a6c159e698 tempest-VolumesListTestJSON-1980068411 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:14:26 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b858e2db-c041-45b0-908a-d8a6c159e698 tempest-VolumesListTestJSON-1980068411 None] Deleted volume successfully. Sep 01 12:14:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b858e2db-c041-45b0-908a-d8a6c159e698 tempest-VolumesListTestJSON-1980068411 None] Lock "cinder-ecd56f0a-1a0f-43cf-a4f7-7250ee689b08-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:26 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7f105f57-73da-42ff-9589-c5e6a8d4e6de 1073741824" returned: 0 in 0.592s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7f105f57-73da-42ff-9589-c5e6a8d4e6de {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:26 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7f105f57-73da-42ff-9589-c5e6a8d4e6de Sep 01 12:14:26 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:26 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7f105f57-73da-42ff-9589-c5e6a8d4e6de" returned: 0 in 0.300s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:14:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ca0a9a-4554-4b74-bc85-a1d495d09bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f105f57-73da-42ff-9589-c5e6a8d4e6de', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8c8c0d-7c35-437d-95ae-216604d105f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:26 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Volume volume-7f105f57-73da-42ff-9589-c5e6a8d4e6de (7f105f57-73da-42ff-9589-c5e6a8d4e6de): created successfully Sep 01 12:14:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8c8c0d-7c35-437d-95ae-216604d105f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Flow 'volume_create_manager' (df59e390-f5c7-4cb3-b48b-e49125d2a3b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:14:26 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f9b0df20-7ecf-4c7c-8d07-9082228705de tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Created volume successfully. Sep 01 12:14:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3f0cf2bd-bc54-4ee0-a7e8-10d6def46648 tempest-VolumesGetTest-73630739 None] Acquiring lock "cinder-5f49b168-b6ee-4f89-9305-b6df3675f080-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:14:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3f0cf2bd-bc54-4ee0-a7e8-10d6def46648 tempest-VolumesGetTest-73630739 None] Lock "cinder-5f49b168-b6ee-4f89-9305-b6df3675f080-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:14:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3f0cf2bd-bc54-4ee0-a7e8-10d6def46648 tempest-VolumesGetTest-73630739 None] Acquiring lock "cinder-quobyte-5f49b168-b6ee-4f89-9305-b6df3675f080" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:14:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3f0cf2bd-bc54-4ee0-a7e8-10d6def46648 tempest-VolumesGetTest-73630739 None] Lock "cinder-quobyte-5f49b168-b6ee-4f89-9305-b6df3675f080" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:14:27 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8162bed-699a-4b21-ab46-dc544c287097]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:14:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3f0cf2bd-bc54-4ee0-a7e8-10d6def46648 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f49b168-b6ee-4f89-9305-b6df3675f080 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-865b60f6-ec6a-42a8-a6d3-fb224ff194e4 tempest-VolumesListTestJSON-1980068411 None] Acquiring lock "cinder-43f69cb6-50d2-4011-883a-d79e3a34a301-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:14:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-865b60f6-ec6a-42a8-a6d3-fb224ff194e4 tempest-VolumesListTestJSON-1980068411 None] Lock "cinder-43f69cb6-50d2-4011-883a-d79e3a34a301-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:14:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-865b60f6-ec6a-42a8-a6d3-fb224ff194e4 tempest-VolumesListTestJSON-1980068411 None] Acquiring lock "cinder-quobyte-43f69cb6-50d2-4011-883a-d79e3a34a301" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:14:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-865b60f6-ec6a-42a8-a6d3-fb224ff194e4 tempest-VolumesListTestJSON-1980068411 None] Lock "cinder-quobyte-43f69cb6-50d2-4011-883a-d79e3a34a301" acquired by "delete_volume" :: waited 0.041s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:14:27 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f49b168-b6ee-4f89-9305-b6df3675f080 Sep 01 12:14:27 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:27 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[663def15-7582-467c-ba38-5201d936f227]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:14:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-865b60f6-ec6a-42a8-a6d3-fb224ff194e4 tempest-VolumesListTestJSON-1980068411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-43f69cb6-50d2-4011-883a-d79e3a34a301 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:27 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-43f69cb6-50d2-4011-883a-d79e3a34a301 Sep 01 12:14:27 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:27 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3f0cf2bd-bc54-4ee0-a7e8-10d6def46648 tempest-VolumesGetTest-73630739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f49b168-b6ee-4f89-9305-b6df3675f080" returned: 0 in 0.754s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3f0cf2bd-bc54-4ee0-a7e8-10d6def46648 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f49b168-b6ee-4f89-9305-b6df3675f080 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:27 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f49b168-b6ee-4f89-9305-b6df3675f080 Sep 01 12:14:27 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:27 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-865b60f6-ec6a-42a8-a6d3-fb224ff194e4 tempest-VolumesListTestJSON-1980068411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-43f69cb6-50d2-4011-883a-d79e3a34a301" returned: 0 in 0.581s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-865b60f6-ec6a-42a8-a6d3-fb224ff194e4 tempest-VolumesListTestJSON-1980068411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-43f69cb6-50d2-4011-883a-d79e3a34a301 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:27 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-43f69cb6-50d2-4011-883a-d79e3a34a301 Sep 01 12:14:27 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:28 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-865b60f6-ec6a-42a8-a6d3-fb224ff194e4 tempest-VolumesListTestJSON-1980068411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-43f69cb6-50d2-4011-883a-d79e3a34a301" returned: 0 in 0.471s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:28 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3f0cf2bd-bc54-4ee0-a7e8-10d6def46648 tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5f49b168-b6ee-4f89-9305-b6df3675f080" returned: 0 in 0.591s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-865b60f6-ec6a-42a8-a6d3-fb224ff194e4 tempest-VolumesListTestJSON-1980068411 None] Lock "cinder-quobyte-43f69cb6-50d2-4011-883a-d79e3a34a301" released by "delete_volume" :: held 1.161s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3f0cf2bd-bc54-4ee0-a7e8-10d6def46648 tempest-VolumesGetTest-73630739 None] Lock "cinder-quobyte-5f49b168-b6ee-4f89-9305-b6df3675f080" released by "delete_volume" :: held 1.428s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-3f0cf2bd-bc54-4ee0-a7e8-10d6def46648 tempest-VolumesGetTest-73630739 None] Created reservations ['5423a109-9b23-4898-a5fb-1095f06b1c0e', '5e51d909-89aa-4ed6-9c0f-15b60d20731b', 'e504be1f-d120-4d52-aefd-70f1cf0642fe', 'e78c93ec-e422-4d3f-bb60-2e6f6611573a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-865b60f6-ec6a-42a8-a6d3-fb224ff194e4 tempest-VolumesListTestJSON-1980068411 None] Created reservations ['f30c7716-ea42-4682-b797-6bd7a5b19d54', '36d93651-aff4-4ed4-840d-f4baf84636d0', '910d9aa6-a459-440f-8a2a-268733dd3d9c', '56b5cc8a-e176-452f-a5be-66330d7f2b36'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3f0cf2bd-bc54-4ee0-a7e8-10d6def46648 tempest-VolumesGetTest-73630739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3f0cf2bd-bc54-4ee0-a7e8-10d6def46648 tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3f0cf2bd-bc54-4ee0-a7e8-10d6def46648 tempest-VolumesGetTest-73630739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3f0cf2bd-bc54-4ee0-a7e8-10d6def46648 tempest-VolumesGetTest-73630739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3f0cf2bd-bc54-4ee0-a7e8-10d6def46648 tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3f0cf2bd-bc54-4ee0-a7e8-10d6def46648 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:28 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:14:28 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-865b60f6-ec6a-42a8-a6d3-fb224ff194e4 tempest-VolumesListTestJSON-1980068411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-865b60f6-ec6a-42a8-a6d3-fb224ff194e4 tempest-VolumesListTestJSON-1980068411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-865b60f6-ec6a-42a8-a6d3-fb224ff194e4 tempest-VolumesListTestJSON-1980068411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-865b60f6-ec6a-42a8-a6d3-fb224ff194e4 tempest-VolumesListTestJSON-1980068411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-865b60f6-ec6a-42a8-a6d3-fb224ff194e4 tempest-VolumesListTestJSON-1980068411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-865b60f6-ec6a-42a8-a6d3-fb224ff194e4 tempest-VolumesListTestJSON-1980068411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:28 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:14:28 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-01621bcd-54fb-4191-b35d-f79d6e8b4ac0 req-57fda717-dc22-4109-8b9d-b9887ed557f8 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-01621bcd-54fb-4191-b35d-f79d6e8b4ac0 req-57fda717-dc22-4109-8b9d-b9887ed557f8 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-01621bcd-54fb-4191-b35d-f79d6e8b4ac0 req-57fda717-dc22-4109-8b9d-b9887ed557f8 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-01621bcd-54fb-4191-b35d-f79d6e8b4ac0 req-57fda717-dc22-4109-8b9d-b9887ed557f8 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-7f105f57-73da-42ff-9589-c5e6a8d4e6de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ca3a38d-ec5d-4830-8d27-363d4a8a5b7f', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:14:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-01621bcd-54fb-4191-b35d-f79d6e8b4ac0 req-57fda717-dc22-4109-8b9d-b9887ed557f8 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] attachment_update completed successfully. Sep 01 12:14:29 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3f0cf2bd-bc54-4ee0-a7e8-10d6def46648 tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.366s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:29 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-3f0cf2bd-bc54-4ee0-a7e8-10d6def46648 tempest-VolumesGetTest-73630739 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:14:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3f0cf2bd-bc54-4ee0-a7e8-10d6def46648 tempest-VolumesGetTest-73630739 None] Deleted volume successfully. Sep 01 12:14:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3f0cf2bd-bc54-4ee0-a7e8-10d6def46648 tempest-VolumesGetTest-73630739 None] Lock "cinder-5f49b168-b6ee-4f89-9305-b6df3675f080-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:29 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-865b60f6-ec6a-42a8-a6d3-fb224ff194e4 tempest-VolumesListTestJSON-1980068411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.347s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:29 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-865b60f6-ec6a-42a8-a6d3-fb224ff194e4 tempest-VolumesListTestJSON-1980068411 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:14:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-865b60f6-ec6a-42a8-a6d3-fb224ff194e4 tempest-VolumesListTestJSON-1980068411 None] Deleted volume successfully. Sep 01 12:14:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-865b60f6-ec6a-42a8-a6d3-fb224ff194e4 tempest-VolumesListTestJSON-1980068411 None] Lock "cinder-43f69cb6-50d2-4011-883a-d79e3a34a301-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d3723231-1ded-496b-90c1-56a5e703d104 tempest-VolumesGetTest-73630739 None] Acquiring lock "cinder-b0ba23c1-a24b-4558-a718-1e1f08ac800f-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:14:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d3723231-1ded-496b-90c1-56a5e703d104 tempest-VolumesGetTest-73630739 None] Lock "cinder-b0ba23c1-a24b-4558-a718-1e1f08ac800f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:14:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d3723231-1ded-496b-90c1-56a5e703d104 tempest-VolumesGetTest-73630739 None] Acquiring lock "cinder-quobyte-b0ba23c1-a24b-4558-a718-1e1f08ac800f" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:14:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d3723231-1ded-496b-90c1-56a5e703d104 tempest-VolumesGetTest-73630739 None] Lock "cinder-quobyte-b0ba23c1-a24b-4558-a718-1e1f08ac800f" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:14:29 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eaf8cf-1a6f-41ac-90b8-63a40e9f51ea]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:14:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d3723231-1ded-496b-90c1-56a5e703d104 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0bddfc9c-f564-4c1c-a630-e9dfd9ccd5ad tempest-VolumesListTestJSON-1980068411 None] Acquiring lock "cinder-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:14:29 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f Sep 01 12:14:29 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0bddfc9c-f564-4c1c-a630-e9dfd9ccd5ad tempest-VolumesListTestJSON-1980068411 None] Lock "cinder-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:14:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0bddfc9c-f564-4c1c-a630-e9dfd9ccd5ad tempest-VolumesListTestJSON-1980068411 None] Acquiring lock "cinder-quobyte-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:14:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0bddfc9c-f564-4c1c-a630-e9dfd9ccd5ad tempest-VolumesListTestJSON-1980068411 None] Lock "cinder-quobyte-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:14:29 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d60925-f5f4-4774-839a-a51794f35e80]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:14:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0bddfc9c-f564-4c1c-a630-e9dfd9ccd5ad tempest-VolumesListTestJSON-1980068411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:29 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29 Sep 01 12:14:29 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:30 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d3723231-1ded-496b-90c1-56a5e703d104 tempest-VolumesGetTest-73630739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f" returned: 0 in 0.582s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d3723231-1ded-496b-90c1-56a5e703d104 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:30 devstack sudo[97506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f Sep 01 12:14:30 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:30 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0bddfc9c-f564-4c1c-a630-e9dfd9ccd5ad tempest-VolumesListTestJSON-1980068411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29" returned: 0 in 0.478s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0bddfc9c-f564-4c1c-a630-e9dfd9ccd5ad tempest-VolumesListTestJSON-1980068411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:30 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29 Sep 01 12:14:30 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:30 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d3723231-1ded-496b-90c1-56a5e703d104 tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b0ba23c1-a24b-4558-a718-1e1f08ac800f" returned: 0 in 0.381s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d3723231-1ded-496b-90c1-56a5e703d104 tempest-VolumesGetTest-73630739 None] Lock "cinder-quobyte-b0ba23c1-a24b-4558-a718-1e1f08ac800f" released by "delete_volume" :: held 1.034s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=117,cinder:INSERT=34,cinder:UPDATE=153,cinder:DELETE=12 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=102,cinder:INSERT=43,cinder:UPDATE=134,cinder:DELETE=14 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-d3723231-1ded-496b-90c1-56a5e703d104 tempest-VolumesGetTest-73630739 None] Created reservations ['dbb4ce85-bd90-405f-b0c5-b7bd3daded6a', '9670b308-5c3b-41f0-bbe7-e9a912bd4111', 'ec6daf3d-34e6-4898-825a-36b70f668c7c', '76193a1e-2bea-436e-a7dd-95297543a07f'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:14:30 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0bddfc9c-f564-4c1c-a630-e9dfd9ccd5ad tempest-VolumesListTestJSON-1980068411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29" returned: 0 in 0.341s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0bddfc9c-f564-4c1c-a630-e9dfd9ccd5ad tempest-VolumesListTestJSON-1980068411 None] Lock "cinder-quobyte-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29" released by "delete_volume" :: held 0.881s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d3723231-1ded-496b-90c1-56a5e703d104 tempest-VolumesGetTest-73630739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d3723231-1ded-496b-90c1-56a5e703d104 tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d3723231-1ded-496b-90c1-56a5e703d104 tempest-VolumesGetTest-73630739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d3723231-1ded-496b-90c1-56a5e703d104 tempest-VolumesGetTest-73630739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d3723231-1ded-496b-90c1-56a5e703d104 tempest-VolumesGetTest-73630739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d3723231-1ded-496b-90c1-56a5e703d104 tempest-VolumesGetTest-73630739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-0bddfc9c-f564-4c1c-a630-e9dfd9ccd5ad tempest-VolumesListTestJSON-1980068411 None] Created reservations ['1b11994e-0df1-477c-a2bd-f7687d335de7', 'd96a8bd8-6c83-41cf-a849-a8d9e8300f95', 'd590e9c0-1a91-4f06-bc7f-4b229bdd3f70', '8288b253-32a9-4967-b9ad-5eefee2f952b'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:14:30 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:14:30 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0bddfc9c-f564-4c1c-a630-e9dfd9ccd5ad tempest-VolumesListTestJSON-1980068411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0bddfc9c-f564-4c1c-a630-e9dfd9ccd5ad tempest-VolumesListTestJSON-1980068411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0bddfc9c-f564-4c1c-a630-e9dfd9ccd5ad tempest-VolumesListTestJSON-1980068411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0bddfc9c-f564-4c1c-a630-e9dfd9ccd5ad tempest-VolumesListTestJSON-1980068411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0bddfc9c-f564-4c1c-a630-e9dfd9ccd5ad tempest-VolumesListTestJSON-1980068411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0bddfc9c-f564-4c1c-a630-e9dfd9ccd5ad tempest-VolumesListTestJSON-1980068411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:30 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:14:30 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:31 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d3723231-1ded-496b-90c1-56a5e703d104 tempest-VolumesGetTest-73630739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.482s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:31 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-d3723231-1ded-496b-90c1-56a5e703d104 tempest-VolumesGetTest-73630739 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:14:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d3723231-1ded-496b-90c1-56a5e703d104 tempest-VolumesGetTest-73630739 None] Deleted volume successfully. Sep 01 12:14:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d3723231-1ded-496b-90c1-56a5e703d104 tempest-VolumesGetTest-73630739 None] Lock "cinder-b0ba23c1-a24b-4558-a718-1e1f08ac800f-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:31 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0bddfc9c-f564-4c1c-a630-e9dfd9ccd5ad tempest-VolumesListTestJSON-1980068411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.752s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:31 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-0bddfc9c-f564-4c1c-a630-e9dfd9ccd5ad tempest-VolumesListTestJSON-1980068411 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:14:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0bddfc9c-f564-4c1c-a630-e9dfd9ccd5ad tempest-VolumesListTestJSON-1980068411 None] Deleted volume successfully. Sep 01 12:14:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0bddfc9c-f564-4c1c-a630-e9dfd9ccd5ad tempest-VolumesListTestJSON-1980068411 None] Lock "cinder-8ab3939d-2fbb-4ee5-b379-db43e7bc7b29-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:34 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-7ccbbef6-ee47-47c4-857f-65de180ff71f req-b8ba8ad4-8875-4c05-be26-8359ee3d3118 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Terminate volume connection completed successfully. Sep 01 12:14:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-7ccbbef6-ee47-47c4-857f-65de180ff71f req-b8ba8ad4-8875-4c05-be26-8359ee3d3118 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Deleting attachment 0ca3a38d-ec5d-4830-8d27-363d4a8a5b7f. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:14:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3575fbeb-1e97-4457-88c8-019baaa7b906 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Acquiring lock "cinder-7f105f57-73da-42ff-9589-c5e6a8d4e6de-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:14:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3575fbeb-1e97-4457-88c8-019baaa7b906 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Lock "cinder-7f105f57-73da-42ff-9589-c5e6a8d4e6de-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:14:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3575fbeb-1e97-4457-88c8-019baaa7b906 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Acquiring lock "cinder-quobyte-7f105f57-73da-42ff-9589-c5e6a8d4e6de" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:14:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3575fbeb-1e97-4457-88c8-019baaa7b906 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Lock "cinder-quobyte-7f105f57-73da-42ff-9589-c5e6a8d4e6de" acquired by "delete_volume" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:14:35 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0376c67d-e2f2-44b2-a2a4-3958190d852d]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:14:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3575fbeb-1e97-4457-88c8-019baaa7b906 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7f105f57-73da-42ff-9589-c5e6a8d4e6de {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:35 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7f105f57-73da-42ff-9589-c5e6a8d4e6de Sep 01 12:14:35 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:35 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3575fbeb-1e97-4457-88c8-019baaa7b906 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7f105f57-73da-42ff-9589-c5e6a8d4e6de" returned: 0 in 0.595s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3575fbeb-1e97-4457-88c8-019baaa7b906 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7f105f57-73da-42ff-9589-c5e6a8d4e6de {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:35 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7f105f57-73da-42ff-9589-c5e6a8d4e6de Sep 01 12:14:35 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:36 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3575fbeb-1e97-4457-88c8-019baaa7b906 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7f105f57-73da-42ff-9589-c5e6a8d4e6de" returned: 0 in 0.658s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3575fbeb-1e97-4457-88c8-019baaa7b906 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Lock "cinder-quobyte-7f105f57-73da-42ff-9589-c5e6a8d4e6de" released by "delete_volume" :: held 1.330s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:36 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-3575fbeb-1e97-4457-88c8-019baaa7b906 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Created reservations ['f4fe0982-0897-453f-b525-35d6ac3313b1', 'b318df35-dcf8-45a4-b621-94029838e4c6', '13a8f866-4b4f-40c4-aeab-a262c6391817', 'f7955cff-5d6b-4301-866f-67db396ec6a4'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:14:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3575fbeb-1e97-4457-88c8-019baaa7b906 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3575fbeb-1e97-4457-88c8-019baaa7b906 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3575fbeb-1e97-4457-88c8-019baaa7b906 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:14:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3575fbeb-1e97-4457-88c8-019baaa7b906 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:14:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3575fbeb-1e97-4457-88c8-019baaa7b906 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3575fbeb-1e97-4457-88c8-019baaa7b906 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:36 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:14:36 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:37 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3575fbeb-1e97-4457-88c8-019baaa7b906 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.361s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-3575fbeb-1e97-4457-88c8-019baaa7b906 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:14:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3575fbeb-1e97-4457-88c8-019baaa7b906 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Deleted volume successfully. Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3575fbeb-1e97-4457-88c8-019baaa7b906 tempest-TestServerVolumeAttachScenarioOldVersion-1781136634 None] Lock "cinder-7f105f57-73da-42ff-9589-c5e6a8d4e6de-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Flow 'volume_create_manager' (794ac3a3-ff35-4c14-a892-0b4d4f86bc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd84570-a813-49b7-a563-616603b971e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd84570-a813-49b7-a563-616603b971e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-650434607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79ec3315-e890-42a3-a12d-3afc4f3440d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63fa375ebaae46249336ed404e1a70f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:14:37Z,use_quota=True,user_id='ceed98de9eb6467893eee2e5bd5b338a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3096f261-a0aa-4890-8e85-45a271fd0956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3096f261-a0aa-4890-8e85-45a271fd0956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3028357c-40ab-4d22-959c-2019cda0fc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3028357c-40ab-4d22-959c-2019cda0fc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79ec3315-e890-42a3-a12d-3afc4f3440d5', 'volume_name': 'volume-79ec3315-e890-42a3-a12d-3afc4f3440d5', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (179d1531-e72e-45b6-b207-0ec1e36fc2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (179d1531-e72e-45b6-b207-0ec1e36fc2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304ceb61-23b0-4343-afd6-c9f0fda43b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:37 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Volume 79ec3315-e890-42a3-a12d-3afc4f3440d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79ec3315-e890-42a3-a12d-3afc4f3440d5', 'volume_size': 1} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-650434607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79ec3315-e890-42a3-a12d-3afc4f3440d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63fa375ebaae46249336ed404e1a70f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:14:37Z,use_quota=True,user_id='ceed98de9eb6467893eee2e5bd5b338a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Creating volume 79ec3315-e890-42a3-a12d-3afc4f3440d5 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:14:37 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:14:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79ec3315-e890-42a3-a12d-3afc4f3440d5 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:37 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79ec3315-e890-42a3-a12d-3afc4f3440d5 1073741824 Sep 01 12:14:37 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:38 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79ec3315-e890-42a3-a12d-3afc4f3440d5 1073741824" returned: 0 in 0.959s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79ec3315-e890-42a3-a12d-3afc4f3440d5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:38 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79ec3315-e890-42a3-a12d-3afc4f3440d5 Sep 01 12:14:38 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:39 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79ec3315-e890-42a3-a12d-3afc4f3440d5" returned: 0 in 0.342s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:14:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304ceb61-23b0-4343-afd6-c9f0fda43b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79ec3315-e890-42a3-a12d-3afc4f3440d5', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6295da-c23b-46c4-897e-079100fc5dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:14:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Volume volume-79ec3315-e890-42a3-a12d-3afc4f3440d5 (79ec3315-e890-42a3-a12d-3afc4f3440d5): created successfully Sep 01 12:14:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6295da-c23b-46c4-897e-079100fc5dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:14:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Flow 'volume_create_manager' (794ac3a3-ff35-4c14-a892-0b4d4f86bc54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:14:39 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-67b0ab52-4b5e-48cb-a508-09a6623108a5 tempest-VolumesNegativeTest-2032583931 None] Created volume successfully. Sep 01 12:14:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:14:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:14:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:14:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:14:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:14:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:14:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:14:41 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:14:41 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:14:42 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Sep 01 12:14:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.431s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:14:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:14:42 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:14:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:14:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:14:49 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=11,cinder:INSERT=6,cinder:UPDATE=32,cinder:DELETE=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:14:49 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=19,cinder:INSERT=7,cinder:UPDATE=20,cinder:DELETE=3 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Flow 'volume_create_manager' (d70a85eb-769c-41c6-9e17-2d4824402766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61dd3501-50ca-46ae-9032-ad08743f52e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61dd3501-50ca-46ae-9032-ad08743f52e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-211468098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4f4159-a7e9-4d29-bb73-ed754317eee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55e72c87e374d6ca6ac118393a2c204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:15:00Z,use_quota=True,user_id='d467767cd2dd4a19a729441172901fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31de0b5f-3159-4a98-9033-99a795a267b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31de0b5f-3159-4a98-9033-99a795a267b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91b7484f-5d62-40cb-ab2e-11e6bce3dee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91b7484f-5d62-40cb-ab2e-11e6bce3dee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db4f4159-a7e9-4d29-bb73-ed754317eee3', 'volume_name': 'volume-db4f4159-a7e9-4d29-bb73-ed754317eee3', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c4e644-25ba-4814-bc16-eb46ad1074f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c4e644-25ba-4814-bc16-eb46ad1074f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d5ba65-69db-4cd9-9c5f-f32a85f4cc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:00 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Volume db4f4159-a7e9-4d29-bb73-ed754317eee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db4f4159-a7e9-4d29-bb73-ed754317eee3', 'volume_size': 1} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-211468098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4f4159-a7e9-4d29-bb73-ed754317eee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55e72c87e374d6ca6ac118393a2c204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:15:00Z,use_quota=True,user_id='d467767cd2dd4a19a729441172901fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Creating volume db4f4159-a7e9-4d29-bb73-ed754317eee3 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:15:00 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-db4f4159-a7e9-4d29-bb73-ed754317eee3 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:00 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-db4f4159-a7e9-4d29-bb73-ed754317eee3 1073741824 Sep 01 12:15:00 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:00 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-db4f4159-a7e9-4d29-bb73-ed754317eee3 1073741824" returned: 0 in 0.621s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-db4f4159-a7e9-4d29-bb73-ed754317eee3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:00 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-db4f4159-a7e9-4d29-bb73-ed754317eee3 Sep 01 12:15:00 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:01 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-db4f4159-a7e9-4d29-bb73-ed754317eee3" returned: 0 in 0.362s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:15:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:15:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d5ba65-69db-4cd9-9c5f-f32a85f4cc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db4f4159-a7e9-4d29-bb73-ed754317eee3', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc5dd7d-75b1-45f2-ad2c-ceee4268729e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:01 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Volume volume-db4f4159-a7e9-4d29-bb73-ed754317eee3 (db4f4159-a7e9-4d29-bb73-ed754317eee3): created successfully Sep 01 12:15:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc5dd7d-75b1-45f2-ad2c-ceee4268729e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Flow 'volume_create_manager' (d70a85eb-769c-41c6-9e17-2d4824402766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:15:01 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b9d706fa-08c4-4815-9ec0-7faf4b53013b tempest-AttachVolumeNegativeTest-36464837 None] Created volume successfully. Sep 01 12:15:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-0953fed7-b98e-45bf-bc13-48c4425cb2c9 req-5310454f-bbb4-4a2f-ba96-7ea2ffe4c6e2 tempest-AttachVolumeNegativeTest-36464837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:15:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-0953fed7-b98e-45bf-bc13-48c4425cb2c9 req-5310454f-bbb4-4a2f-ba96-7ea2ffe4c6e2 tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:15:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-0953fed7-b98e-45bf-bc13-48c4425cb2c9 req-5310454f-bbb4-4a2f-ba96-7ea2ffe4c6e2 tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:15:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-0953fed7-b98e-45bf-bc13-48c4425cb2c9 req-5310454f-bbb4-4a2f-ba96-7ea2ffe4c6e2 tempest-AttachVolumeNegativeTest-36464837 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-db4f4159-a7e9-4d29-bb73-ed754317eee3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca8d0bbf-9cc5-4b35-8f9f-4388886e8850', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:15:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-0953fed7-b98e-45bf-bc13-48c4425cb2c9 req-5310454f-bbb4-4a2f-ba96-7ea2ffe4c6e2 tempest-AttachVolumeNegativeTest-36464837 None] attachment_update completed successfully. Sep 01 12:15:07 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-4b425e3a-dd31-4c90-bbbe-a726846e3710 req-e92fcc43-7ccb-46f9-924b-bc251cc33fff tempest-AttachVolumeNegativeTest-36464837 None] Terminate volume connection completed successfully. Sep 01 12:15:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-4b425e3a-dd31-4c90-bbbe-a726846e3710 req-e92fcc43-7ccb-46f9-924b-bc251cc33fff tempest-AttachVolumeNegativeTest-36464837 None] Deleting attachment ca8d0bbf-9cc5-4b35-8f9f-4388886e8850. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:15:13 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=5,cinder:SELECT=8,cinder:INSERT=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:15:17 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:15:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0356d42e-d19c-4b07-9328-e1f288e1ed79 tempest-VolumesNegativeTest-2032583931 None] Acquiring lock "cinder-79ec3315-e890-42a3-a12d-3afc4f3440d5-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:15:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0356d42e-d19c-4b07-9328-e1f288e1ed79 tempest-VolumesNegativeTest-2032583931 None] Lock "cinder-79ec3315-e890-42a3-a12d-3afc4f3440d5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:15:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0356d42e-d19c-4b07-9328-e1f288e1ed79 tempest-VolumesNegativeTest-2032583931 None] Acquiring lock "cinder-quobyte-79ec3315-e890-42a3-a12d-3afc4f3440d5" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:15:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0356d42e-d19c-4b07-9328-e1f288e1ed79 tempest-VolumesNegativeTest-2032583931 None] Lock "cinder-quobyte-79ec3315-e890-42a3-a12d-3afc4f3440d5" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:15:18 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eeca184-c6f4-419c-a9a8-2a996f0b5c13]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:15:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0356d42e-d19c-4b07-9328-e1f288e1ed79 tempest-VolumesNegativeTest-2032583931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79ec3315-e890-42a3-a12d-3afc4f3440d5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:18 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79ec3315-e890-42a3-a12d-3afc4f3440d5 Sep 01 12:15:18 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:19 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0356d42e-d19c-4b07-9328-e1f288e1ed79 tempest-VolumesNegativeTest-2032583931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79ec3315-e890-42a3-a12d-3afc4f3440d5" returned: 0 in 0.529s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0356d42e-d19c-4b07-9328-e1f288e1ed79 tempest-VolumesNegativeTest-2032583931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79ec3315-e890-42a3-a12d-3afc4f3440d5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:19 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79ec3315-e890-42a3-a12d-3afc4f3440d5 Sep 01 12:15:19 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:19 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0356d42e-d19c-4b07-9328-e1f288e1ed79 tempest-VolumesNegativeTest-2032583931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-79ec3315-e890-42a3-a12d-3afc4f3440d5" returned: 0 in 0.410s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0356d42e-d19c-4b07-9328-e1f288e1ed79 tempest-VolumesNegativeTest-2032583931 None] Lock "cinder-quobyte-79ec3315-e890-42a3-a12d-3afc4f3440d5" released by "delete_volume" :: held 1.006s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:15:19 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-0356d42e-d19c-4b07-9328-e1f288e1ed79 tempest-VolumesNegativeTest-2032583931 None] Created reservations ['c8afacda-00d1-4e49-a066-0739b9e48d91', '51664440-fd5e-451f-8b6e-475e1d1e806d', 'c21184f2-18b6-40ec-991c-179737e2c01e', 'ae8c2d6c-bbe9-48fd-81dc-be6561387213'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:15:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0356d42e-d19c-4b07-9328-e1f288e1ed79 tempest-VolumesNegativeTest-2032583931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:15:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0356d42e-d19c-4b07-9328-e1f288e1ed79 tempest-VolumesNegativeTest-2032583931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:15:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0356d42e-d19c-4b07-9328-e1f288e1ed79 tempest-VolumesNegativeTest-2032583931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:15:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0356d42e-d19c-4b07-9328-e1f288e1ed79 tempest-VolumesNegativeTest-2032583931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:15:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0356d42e-d19c-4b07-9328-e1f288e1ed79 tempest-VolumesNegativeTest-2032583931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:15:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0356d42e-d19c-4b07-9328-e1f288e1ed79 tempest-VolumesNegativeTest-2032583931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:19 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:15:19 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:20 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0356d42e-d19c-4b07-9328-e1f288e1ed79 tempest-VolumesNegativeTest-2032583931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.525s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:20 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-0356d42e-d19c-4b07-9328-e1f288e1ed79 tempest-VolumesNegativeTest-2032583931 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:15:20 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0356d42e-d19c-4b07-9328-e1f288e1ed79 tempest-VolumesNegativeTest-2032583931 None] Deleted volume successfully. Sep 01 12:15:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0356d42e-d19c-4b07-9328-e1f288e1ed79 tempest-VolumesNegativeTest-2032583931 None] Lock "cinder-79ec3315-e890-42a3-a12d-3afc4f3440d5-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Flow 'volume_create_manager' (5af7b039-5bc0-41d1-be85-7fe2e8ac75a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11295c8c-e511-49e1-9c3f-f76196db66cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11295c8c-e511-49e1-9c3f-f76196db66cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1532566740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac190fbf-7f39-4860-89af-88b9eab4c997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51d0cba4c0d44b748b899c654ee6bd93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:15:26Z,use_quota=True,user_id='6fcfcfc1fc414b2a8d048acb89587304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58c6919-c58b-41c7-ab72-6aa02be5b2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58c6919-c58b-41c7-ab72-6aa02be5b2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5effb0ba-3863-441b-81ad-3841fb0b9ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5effb0ba-3863-441b-81ad-3841fb0b9ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac190fbf-7f39-4860-89af-88b9eab4c997', 'volume_name': 'volume-ac190fbf-7f39-4860-89af-88b9eab4c997', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6a03c8-20eb-40a0-9fdf-7510378018f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6a03c8-20eb-40a0-9fdf-7510378018f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb11617-e47d-4978-9e81-b3877e448f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:26 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Volume ac190fbf-7f39-4860-89af-88b9eab4c997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac190fbf-7f39-4860-89af-88b9eab4c997', 'volume_size': 1} Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1532566740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac190fbf-7f39-4860-89af-88b9eab4c997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51d0cba4c0d44b748b899c654ee6bd93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:15:26Z,use_quota=True,user_id='6fcfcfc1fc414b2a8d048acb89587304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Creating volume ac190fbf-7f39-4860-89af-88b9eab4c997 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:15:26 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:15:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac190fbf-7f39-4860-89af-88b9eab4c997 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:26 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac190fbf-7f39-4860-89af-88b9eab4c997 1073741824 Sep 01 12:15:26 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:27 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac190fbf-7f39-4860-89af-88b9eab4c997 1073741824" returned: 0 in 0.870s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac190fbf-7f39-4860-89af-88b9eab4c997 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:27 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac190fbf-7f39-4860-89af-88b9eab4c997 Sep 01 12:15:27 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:28 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac190fbf-7f39-4860-89af-88b9eab4c997" returned: 0 in 0.564s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:15:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:15:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb11617-e47d-4978-9e81-b3877e448f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac190fbf-7f39-4860-89af-88b9eab4c997', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb11cbac-c0b0-4c76-b62c-e75189dfc588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:28 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Volume volume-ac190fbf-7f39-4860-89af-88b9eab4c997 (ac190fbf-7f39-4860-89af-88b9eab4c997): created successfully Sep 01 12:15:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb11cbac-c0b0-4c76-b62c-e75189dfc588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Flow 'volume_create_manager' (5af7b039-5bc0-41d1-be85-7fe2e8ac75a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:15:28 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8701f8bb-0379-46d3-9e72-b6a87c04c05c tempest-TestMinimumBasicScenario-2138008308 None] Created volume successfully. Sep 01 12:15:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-26f328e8-75a4-4f0b-8a02-daf7d88a5e25 req-1f60c5c6-654e-4cbf-8f00-3395816727b0 tempest-TestMinimumBasicScenario-2138008308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:15:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-26f328e8-75a4-4f0b-8a02-daf7d88a5e25 req-1f60c5c6-654e-4cbf-8f00-3395816727b0 tempest-TestMinimumBasicScenario-2138008308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:15:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-26f328e8-75a4-4f0b-8a02-daf7d88a5e25 req-1f60c5c6-654e-4cbf-8f00-3395816727b0 tempest-TestMinimumBasicScenario-2138008308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:15:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-26f328e8-75a4-4f0b-8a02-daf7d88a5e25 req-1f60c5c6-654e-4cbf-8f00-3395816727b0 tempest-TestMinimumBasicScenario-2138008308 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-ac190fbf-7f39-4860-89af-88b9eab4c997', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d8fbf20-57ee-48d4-a188-b143b47c4024', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:15:30 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-26f328e8-75a4-4f0b-8a02-daf7d88a5e25 req-1f60c5c6-654e-4cbf-8f00-3395816727b0 tempest-TestMinimumBasicScenario-2138008308 None] attachment_update completed successfully. Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Flow 'volume_create_manager' (627beb7b-0bff-4fda-845b-b35e461779f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32472102-7a85-4f7e-a401-e9e61a7a37ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32472102-7a85-4f7e-a401-e9e61a7a37ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1786227271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff26b592e3440bb9e9fc1ee49163e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:15:40Z,use_quota=True,user_id='89bbbf46a98244928201e1252d4c515b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fedf7b93-1533-40b5-aaea-4407701062b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fedf7b93-1533-40b5-aaea-4407701062b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e493645-b467-4a0a-88d2-66881050cde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e493645-b467-4a0a-88d2-66881050cde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca', 'volume_name': 'volume-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f5ad29-475d-49a6-97a5-94c40a932728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f5ad29-475d-49a6-97a5-94c40a932728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aafe9033-e91b-45b0-9f6a-ebe57c2e948e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:40 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Volume 1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca', 'volume_size': 1} Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1786227271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff26b592e3440bb9e9fc1ee49163e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:15:40Z,use_quota=True,user_id='89bbbf46a98244928201e1252d4c515b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Creating volume 1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:15:40 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:15:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:40 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca 1073741824 Sep 01 12:15:40 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Flow 'volume_create_manager' (18e13997-7212-475e-92f3-2709188ff000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60af967e-61fe-4620-8461-39dfb5f85f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60af967e-61fe-4620-8461-39dfb5f85f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2044382702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff26b592e3440bb9e9fc1ee49163e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:15:41Z,use_quota=True,user_id='89bbbf46a98244928201e1252d4c515b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc59135-5996-4ec5-9887-0cae3e3a1ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc59135-5996-4ec5-9887-0cae3e3a1ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1db11a-6880-46f7-a265-dd1d00db4894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1db11a-6880-46f7-a265-dd1d00db4894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023', 'volume_name': 'volume-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6baa95-7747-40de-b06f-8d6ce22ca102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6baa95-7747-40de-b06f-8d6ce22ca102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36dff39-651a-44d3-843c-186ea155d0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Volume 4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023', 'volume_size': 1} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:15:41 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca 1073741824" returned: 0 in 0.777s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:41 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca Sep 01 12:15:41 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:41 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca" returned: 0 in 0.370s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.609s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2044382702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff26b592e3440bb9e9fc1ee49163e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:15:41Z,use_quota=True,user_id='89bbbf46a98244928201e1252d4c515b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Creating volume 4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:15:41 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:41 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:15:41 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:41 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023 1073741824 Sep 01 12:15:41 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aafe9033-e91b-45b0-9f6a-ebe57c2e948e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca895109-90ba-491c-b1d6-1969872d0579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Volume volume-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca (1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca): created successfully Sep 01 12:15:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca895109-90ba-491c-b1d6-1969872d0579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Flow 'volume_create_manager' (627beb7b-0bff-4fda-845b-b35e461779f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:15:42 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-60649135-102b-43b0-ad18-6c19c3e368aa tempest-TestServerVolumeAttachmentScenario-1121532767 None] Created volume successfully. Sep 01 12:15:42 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:15:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Flow 'volume_create_manager' (867869cf-8996-44ba-8317-603146c82594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:15:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b31a34-497e-43c5-b496-361b045b7577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b31a34-497e-43c5-b496-361b045b7577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-675240150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7adbf8c-15f4-4933-bf53-44b3be8b4833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887183f04898416bb6d0e0d14c5afe2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:15:42Z,use_quota=True,user_id='5a95aaa9132d418f9af74530431b6c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3df9a49-a109-41f2-8897-37eced159eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3df9a49-a109-41f2-8897-37eced159eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50d4be6-79c0-4ea9-95cb-9ba2123d50f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50d4be6-79c0-4ea9-95cb-9ba2123d50f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7adbf8c-15f4-4933-bf53-44b3be8b4833', 'volume_name': 'volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a153fe-4b7e-46e1-aead-ea5612825b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a153fe-4b7e-46e1-aead-ea5612825b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c62ea1d-7231-42ec-a424-d82732484b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:42 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Volume e7adbf8c-15f4-4933-bf53-44b3be8b4833: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833', 'volume_size': 1} Sep 01 12:15:42 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:15:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.497s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:15:42 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:15:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:15:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:15:42 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023 1073741824" returned: 0 in 1.020s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:42 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023 Sep 01 12:15:42 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:43 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023" returned: 0 in 0.434s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:15:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:15:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.102s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:15:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-675240150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7adbf8c-15f4-4933-bf53-44b3be8b4833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887183f04898416bb6d0e0d14c5afe2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:15:42Z,use_quota=True,user_id='5a95aaa9132d418f9af74530431b6c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:15:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Creating volume e7adbf8c-15f4-4933-bf53-44b3be8b4833 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:15:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:15:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:15:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:15:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:15:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:15:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:15:43 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:15:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:43 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833 1073741824 Sep 01 12:15:43 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36dff39-651a-44d3-843c-186ea155d0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2930fa95-01fe-4a44-9576-09696d36faa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:43 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Volume volume-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023 (4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023): created successfully Sep 01 12:15:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2930fa95-01fe-4a44-9576-09696d36faa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Flow 'volume_create_manager' (18e13997-7212-475e-92f3-2709188ff000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:15:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-230204a0-1d5a-41f2-967e-e0e0791753b7 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Created volume successfully. Sep 01 12:15:44 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833 1073741824" returned: 0 in 0.844s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:44 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833 Sep 01 12:15:44 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:44 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833" returned: 0 in 0.320s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:15:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:15:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c62ea1d-7231-42ec-a424-d82732484b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5651970f-460e-4352-bfa4-14b4085f4ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:44 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Volume volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833 (e7adbf8c-15f4-4933-bf53-44b3be8b4833): created successfully Sep 01 12:15:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5651970f-460e-4352-bfa4-14b4085f4ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Flow 'volume_create_manager' (867869cf-8996-44ba-8317-603146c82594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:15:44 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-492e9233-547a-4228-a683-cee7170ef215 tempest-VolumesSnapshotTestJSON-607027352 None] Created volume successfully. Sep 01 12:15:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-896e64f7-8821-4689-b6f4-d1f238ff41bf tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:15:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-896e64f7-8821-4689-b6f4-d1f238ff41bf tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:15:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-896e64f7-8821-4689-b6f4-d1f238ff41bf tempest-VolumesSnapshotTestJSON-607027352 None] Creating offline snapshot 38e99b25-d001-4b28-a613-e66db215a2f3 of volume e7adbf8c-15f4-4933-bf53-44b3be8b4833 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:15:45 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3b86bd-2433-46c4-903e-7db7ac38e157]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:15:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-896e64f7-8821-4689-b6f4-d1f238ff41bf tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:46 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833 Sep 01 12:15:46 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:46 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-896e64f7-8821-4689-b6f4-d1f238ff41bf tempest-VolumesSnapshotTestJSON-607027352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833" returned: 0 in 0.591s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-896e64f7-8821-4689-b6f4-d1f238ff41bf tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.38e99b25-d001-4b28-a613-e66db215a2f3 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:46 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.38e99b25-d001-4b28-a613-e66db215a2f3 1G Sep 01 12:15:46 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:47 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-896e64f7-8821-4689-b6f4-d1f238ff41bf tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.38e99b25-d001-4b28-a613-e66db215a2f3 1G" returned: 0 in 0.757s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-896e64f7-8821-4689-b6f4-d1f238ff41bf tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.38e99b25-d001-4b28-a613-e66db215a2f3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:47 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.38e99b25-d001-4b28-a613-e66db215a2f3 Sep 01 12:15:47 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:47 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-896e64f7-8821-4689-b6f4-d1f238ff41bf tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.38e99b25-d001-4b28-a613-e66db215a2f3" returned: 0 in 0.587s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:47 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-896e64f7-8821-4689-b6f4-d1f238ff41bf tempest-VolumesSnapshotTestJSON-607027352 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.38e99b25-d001-4b28-a613-e66db215a2f3 is being set with open permissions: ugo+rw Sep 01 12:15:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-896e64f7-8821-4689-b6f4-d1f238ff41bf tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.38e99b25-d001-4b28-a613-e66db215a2f3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:47 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.38e99b25-d001-4b28-a613-e66db215a2f3 Sep 01 12:15:47 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:48 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-896e64f7-8821-4689-b6f4-d1f238ff41bf tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.38e99b25-d001-4b28-a613-e66db215a2f3" returned: 0 in 0.362s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-896e64f7-8821-4689-b6f4-d1f238ff41bf tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:48 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.info Sep 01 12:15:48 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:48 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-896e64f7-8821-4689-b6f4-d1f238ff41bf tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.info" returned: 0 in 0.396s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:48 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-896e64f7-8821-4689-b6f4-d1f238ff41bf tempest-VolumesSnapshotTestJSON-607027352 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.info is being set with open permissions: ugo+rw Sep 01 12:15:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-896e64f7-8821-4689-b6f4-d1f238ff41bf tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:48 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.info Sep 01 12:15:48 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:49 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-896e64f7-8821-4689-b6f4-d1f238ff41bf tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.info" returned: 0 in 0.393s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-896e64f7-8821-4689-b6f4-d1f238ff41bf tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.233s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:15:49 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-896e64f7-8821-4689-b6f4-d1f238ff41bf tempest-VolumesSnapshotTestJSON-607027352 None] Create snapshot completed successfully Sep 01 12:15:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-38e99b25-d001-4b28-a613-e66db215a2f3-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:15:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-38e99b25-d001-4b28-a613-e66db215a2f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:15:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-quobyte-e7adbf8c-15f4-4933-bf53-44b3be8b4833" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:15:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-e7adbf8c-15f4-4933-bf53-44b3be8b4833" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:15:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-quobyte-38e99b25-d001-4b28-a613-e66db215a2f3" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:15:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-38e99b25-d001-4b28-a613-e66db215a2f3" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:15:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] Deleting offline snapshot 38e99b25-d001-4b28-a613-e66db215a2f3 of volume e7adbf8c-15f4-4933-bf53-44b3be8b4833 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:15:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] snapshot_file for this snap is: volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.38e99b25-d001-4b28-a613-e66db215a2f3 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:15:50 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14f458f-3e0d-4167-8a54-4e61f9c73f1e]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:15:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.38e99b25-d001-4b28-a613-e66db215a2f3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:51 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.38e99b25-d001-4b28-a613-e66db215a2f3 Sep 01 12:15:51 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:51 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.38e99b25-d001-4b28-a613-e66db215a2f3" returned: 0 in 0.636s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:15:51 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1df153-1eb4-4716-aff8-b97e9fd6d50c]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:15:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:51 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833 Sep 01 12:15:51 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:52 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833" returned: 0 in 0.667s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.38e99b25-d001-4b28-a613-e66db215a2f3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:52 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.38e99b25-d001-4b28-a613-e66db215a2f3 Sep 01 12:15:52 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:52 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.38e99b25-d001-4b28-a613-e66db215a2f3" returned: 0 in 0.711s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.38e99b25-d001-4b28-a613-e66db215a2f3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:52 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.38e99b25-d001-4b28-a613-e66db215a2f3 Sep 01 12:15:52 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:53 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833.38e99b25-d001-4b28-a613-e66db215a2f3" returned: 0 in 0.604s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-38e99b25-d001-4b28-a613-e66db215a2f3" released by "_delete_snapshot" :: held 2.832s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:15:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-e7adbf8c-15f4-4933-bf53-44b3be8b4833" released by "delete_snapshot" :: held 2.889s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:15:53 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] Created reservations ['ce7ec761-a866-41fe-808d-112f3de8c9e4', 'c5d717bd-4d35-4fd7-9ea7-d3f4bc8e3e36', '9100a7e9-7937-4598-8219-4ebc923c6e43', 'f4b767f8-d6f5-4ee6-ba6f-b11d4d665b60'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:15:53 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] Delete snapshot completed successfully. Sep 01 12:15:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ab747642-47cc-45e3-8bc0-ba31b7d5857f tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-38e99b25-d001-4b28-a613-e66db215a2f3-delete_snapshot" released by "delete_snapshot" :: held 3.307s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Flow 'volume_create_manager' (4dc8b7df-cea9-4152-8bfa-b0bf0100f48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6235efa7-4b55-42a6-b99b-f042b8daada8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6235efa7-4b55-42a6-b99b-f042b8daada8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1697652293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc0f3619-b5dd-4671-8926-57ea24b9e207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887183f04898416bb6d0e0d14c5afe2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:15:55Z,use_quota=True,user_id='5a95aaa9132d418f9af74530431b6c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a06be5-efe4-4644-8448-1e1ae99fd542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a06be5-efe4-4644-8448-1e1ae99fd542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f037542-7cb1-4bd6-ba20-ddb033a3d316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f037542-7cb1-4bd6-ba20-ddb033a3d316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc0f3619-b5dd-4671-8926-57ea24b9e207', 'volume_name': 'volume-bc0f3619-b5dd-4671-8926-57ea24b9e207', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca61d24-6180-4900-aae2-0e6edb59ccf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca61d24-6180-4900-aae2-0e6edb59ccf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e70a9708-7217-4596-96d0-281e8c6d1cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:54 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Volume bc0f3619-b5dd-4671-8926-57ea24b9e207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc0f3619-b5dd-4671-8926-57ea24b9e207', 'volume_size': 1} Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1697652293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc0f3619-b5dd-4671-8926-57ea24b9e207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887183f04898416bb6d0e0d14c5afe2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:15:55Z,use_quota=True,user_id='5a95aaa9132d418f9af74530431b6c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Creating volume bc0f3619-b5dd-4671-8926-57ea24b9e207 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:15:54 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:15:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:55 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 1073741824 Sep 01 12:15:55 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:55 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 1073741824" returned: 0 in 0.854s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:55 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 Sep 01 12:15:55 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:56 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207" returned: 0 in 0.277s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:15:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:15:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e70a9708-7217-4596-96d0-281e8c6d1cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc0f3619-b5dd-4671-8926-57ea24b9e207', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc0f029-ea7f-4863-be7c-8444ff654c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:15:56 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Volume volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 (bc0f3619-b5dd-4671-8926-57ea24b9e207): created successfully Sep 01 12:15:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc0f029-ea7f-4863-be7c-8444ff654c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:15:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Flow 'volume_create_manager' (4dc8b7df-cea9-4152-8bfa-b0bf0100f48e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:15:56 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-085f6e43-d4a1-48ca-83d2-ac8562485782 tempest-VolumesSnapshotTestJSON-607027352 None] Created volume successfully. Sep 01 12:15:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f2abd321-144b-4ae0-a97e-f71de9d36039 tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:15:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f2abd321-144b-4ae0-a97e-f71de9d36039 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:15:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f2abd321-144b-4ae0-a97e-f71de9d36039 tempest-VolumesSnapshotTestJSON-607027352 None] Creating offline snapshot f05eb475-c564-45be-8207-b4867c89be68 of volume bc0f3619-b5dd-4671-8926-57ea24b9e207 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:15:57 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[805ed651-d921-4806-9ba8-8c448c34bda4]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:15:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2abd321-144b-4ae0-a97e-f71de9d36039 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:57 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 Sep 01 12:15:57 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:58 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2abd321-144b-4ae0-a97e-f71de9d36039 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207" returned: 0 in 0.592s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2abd321-144b-4ae0-a97e-f71de9d36039 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:58 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68 1G Sep 01 12:15:58 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:58 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2abd321-144b-4ae0-a97e-f71de9d36039 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68 1G" returned: 0 in 0.695s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2abd321-144b-4ae0-a97e-f71de9d36039 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:58 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68 Sep 01 12:15:58 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:59 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2abd321-144b-4ae0-a97e-f71de9d36039 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68" returned: 0 in 0.369s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:59 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-f2abd321-144b-4ae0-a97e-f71de9d36039 tempest-VolumesSnapshotTestJSON-607027352 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68 is being set with open permissions: ugo+rw Sep 01 12:15:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2abd321-144b-4ae0-a97e-f71de9d36039 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:59 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68 Sep 01 12:15:59 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:15:59 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Sep 01 12:15:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2abd321-144b-4ae0-a97e-f71de9d36039 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68" returned: 0 in 0.431s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:15:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2abd321-144b-4ae0-a97e-f71de9d36039 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:15:59 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.info Sep 01 12:15:59 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:00 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2abd321-144b-4ae0-a97e-f71de9d36039 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.info" returned: 0 in 0.456s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:00 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-f2abd321-144b-4ae0-a97e-f71de9d36039 tempest-VolumesSnapshotTestJSON-607027352 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.info is being set with open permissions: ugo+rw Sep 01 12:16:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2abd321-144b-4ae0-a97e-f71de9d36039 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:00 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.info Sep 01 12:16:00 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:00 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2abd321-144b-4ae0-a97e-f71de9d36039 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.info" returned: 0 in 0.426s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f2abd321-144b-4ae0-a97e-f71de9d36039 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.160s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:00 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f2abd321-144b-4ae0-a97e-f71de9d36039 tempest-VolumesSnapshotTestJSON-607027352 None] Create snapshot completed successfully Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Flow 'volume_create_manager' (b4f1cc76-8e3a-48ad-8f18-7c2f87c60c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb26723-c547-4691-8053-be16531be524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb26723-c547-4691-8053-be16531be524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-359411342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e89f1e-7941-49e7-922a-d4ff86faa485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887183f04898416bb6d0e0d14c5afe2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:16:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f05eb475-c564-45be-8207-b4867c89be68,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:16:02Z,use_quota=True,user_id='5a95aaa9132d418f9af74530431b6c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952285ae-e64b-48f3-9114-bf0f7383a7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952285ae-e64b-48f3-9114-bf0f7383a7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23bc4560-b487-4039-ab73-a7711429f918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23bc4560-b487-4039-ab73-a7711429f918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '19e89f1e-7941-49e7-922a-d4ff86faa485', 'volume_name': 'volume-19e89f1e-7941-49e7-922a-d4ff86faa485', 'volume_size': 2, 'snapshot_id': 'f05eb475-c564-45be-8207-b4867c89be68'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36c3e6f-aa04-4a46-bb6f-e8bee6612475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36c3e6f-aa04-4a46-bb6f-e8bee6612475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e737ed37-e63b-431f-86bb-6ba117c424d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:02 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Volume 19e89f1e-7941-49e7-922a-d4ff86faa485: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-19e89f1e-7941-49e7-922a-d4ff86faa485', 'volume_size': 2, 'snapshot_id': 'f05eb475-c564-45be-8207-b4867c89be68'} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-quobyte-f05eb475-c564-45be-8207-b4867c89be68-19e89f1e-7941-49e7-922a-d4ff86faa485" by "_create_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-f05eb475-c564-45be-8207-b4867c89be68-19e89f1e-7941-49e7-922a-d4ff86faa485" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Creating volume 19e89f1e-7941-49e7-922a-d4ff86faa485 from snapshot f05eb475-c564-45be-8207-b4867c89be68 {{(pid=87084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-quobyte-19e89f1e-7941-49e7-922a-d4ff86faa485" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-19e89f1e-7941-49e7-922a-d4ff86faa485" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] snapshot: f05eb475-c564-45be-8207-b4867c89be68, volume: 19e89f1e-7941-49e7-922a-d4ff86faa485, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96e7e3c-b170-4a2a-914d-b28179d3a3dc]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:02 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68 Sep 01 12:16:02 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:03 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68" returned: 0 in 0.425s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc0f3619-b5dd-4671-8926-57ea24b9e207(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:16:03 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3d1257-4045-4c47-b046-68794ded81a4]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:03 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 Sep 01 12:16:03 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:03 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207" returned: 0 in 0.420s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:16:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:16:03 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Path /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19e89f1e-7941-49e7-922a-d4ff86faa485 not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:16:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19e89f1e-7941-49e7-922a-d4ff86faa485 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:03 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19e89f1e-7941-49e7-922a-d4ff86faa485 Sep 01 12:16:03 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:11 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19e89f1e-7941-49e7-922a-d4ff86faa485" returned: 0 in 8.313s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:11 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207, size 1024.00 MB, duration 8.31 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19e89f1e-7941-49e7-922a-d4ff86faa485 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:16:11 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Converted 1024.00 MB image at 123.16 MB/s Sep 01 12:16:11 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19e89f1e-7941-49e7-922a-d4ff86faa485 is being set with open permissions: ugo+rw Sep 01 12:16:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19e89f1e-7941-49e7-922a-d4ff86faa485 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:11 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19e89f1e-7941-49e7-922a-d4ff86faa485 Sep 01 12:16:11 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:12 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19e89f1e-7941-49e7-922a-d4ff86faa485" returned: 0 in 0.540s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-19e89f1e-7941-49e7-922a-d4ff86faa485" released by "_copy_volume_from_snapshot" :: held 9.803s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-f05eb475-c564-45be-8207-b4867c89be68-19e89f1e-7941-49e7-922a-d4ff86faa485" released by "_create_volume_from_snapshot" :: held 9.952s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.969s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e737ed37-e63b-431f-86bb-6ba117c424d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19e89f1e-7941-49e7-922a-d4ff86faa485', 'volume_size': 2, 'snapshot_id': 'f05eb475-c564-45be-8207-b4867c89be68'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2706b0d-f1d6-4f5b-9b5e-d7206a4df837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:12 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Volume volume-19e89f1e-7941-49e7-922a-d4ff86faa485 (19e89f1e-7941-49e7-922a-d4ff86faa485): created successfully Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2706b0d-f1d6-4f5b-9b5e-d7206a4df837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Flow 'volume_create_manager' (b4f1cc76-8e3a-48ad-8f18-7c2f87c60c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:16:12 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c4063ff7-492f-495b-a80b-7c9db237421a tempest-VolumesSnapshotTestJSON-607027352 None] Created volume successfully. Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Flow 'volume_create_manager' (d04ebe8c-9d61-4328-bdb1-5698bdce509d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2aa793-c577-428a-8df2-852cb7d6156b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2aa793-c577-428a-8df2-852cb7d6156b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1497442836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecfd8ca8-5469-4ea7-b3cf-8de2b9526add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55e72c87e374d6ca6ac118393a2c204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:16:13Z,use_quota=True,user_id='d467767cd2dd4a19a729441172901fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcc9265-a1d1-4c84-abd8-6d78c642230d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcc9265-a1d1-4c84-abd8-6d78c642230d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c0e074-e079-4279-b4f0-63b07db8c532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c0e074-e079-4279-b4f0-63b07db8c532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecfd8ca8-5469-4ea7-b3cf-8de2b9526add', 'volume_name': 'volume-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d03405-4a81-4921-b318-a4e524f2d463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d03405-4a81-4921-b318-a4e524f2d463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719fbd96-ddc0-446a-a7d2-6e0d230d2ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:12 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Volume ecfd8ca8-5469-4ea7-b3cf-8de2b9526add: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add', 'volume_size': 1} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1497442836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecfd8ca8-5469-4ea7-b3cf-8de2b9526add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55e72c87e374d6ca6ac118393a2c204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:16:13Z,use_quota=True,user_id='d467767cd2dd4a19a729441172901fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Creating volume ecfd8ca8-5469-4ea7-b3cf-8de2b9526add {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:16:12 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:16:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:12 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add 1073741824 Sep 01 12:16:12 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a9e42442-486c-4295-93a2-276eb5ccc5f5 tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-19e89f1e-7941-49e7-922a-d4ff86faa485-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:13 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a9e42442-486c-4295-93a2-276eb5ccc5f5 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-19e89f1e-7941-49e7-922a-d4ff86faa485-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add 1073741824" returned: 0 in 0.575s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a9e42442-486c-4295-93a2-276eb5ccc5f5 tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-quobyte-19e89f1e-7941-49e7-922a-d4ff86faa485" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a9e42442-486c-4295-93a2-276eb5ccc5f5 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-19e89f1e-7941-49e7-922a-d4ff86faa485" acquired by "delete_volume" :: waited 0.048s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:13 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add Sep 01 12:16:13 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:13 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf8e86a-c950-4e3b-8563-2fb0414bf9ea]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a9e42442-486c-4295-93a2-276eb5ccc5f5 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19e89f1e-7941-49e7-922a-d4ff86faa485 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:13 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19e89f1e-7941-49e7-922a-d4ff86faa485 Sep 01 12:16:13 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:13 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add" returned: 0 in 0.289s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:16:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719fbd96-ddc0-446a-a7d2-6e0d230d2ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b49541-4922-408a-b5e5-03d8c51de54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:13 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Volume volume-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add (ecfd8ca8-5469-4ea7-b3cf-8de2b9526add): created successfully Sep 01 12:16:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b49541-4922-408a-b5e5-03d8c51de54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Flow 'volume_create_manager' (d04ebe8c-9d61-4328-bdb1-5698bdce509d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:16:13 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b593b7a6-a104-47c3-8518-330f7c1a2aec tempest-AttachVolumeNegativeTest-36464837 None] Created volume successfully. Sep 01 12:16:14 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a9e42442-486c-4295-93a2-276eb5ccc5f5 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19e89f1e-7941-49e7-922a-d4ff86faa485" returned: 0 in 0.461s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a9e42442-486c-4295-93a2-276eb5ccc5f5 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19e89f1e-7941-49e7-922a-d4ff86faa485 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:14 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19e89f1e-7941-49e7-922a-d4ff86faa485 Sep 01 12:16:14 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:14 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a9e42442-486c-4295-93a2-276eb5ccc5f5 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19e89f1e-7941-49e7-922a-d4ff86faa485" returned: 0 in 0.253s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a9e42442-486c-4295-93a2-276eb5ccc5f5 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-19e89f1e-7941-49e7-922a-d4ff86faa485" released by "delete_volume" :: held 0.787s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=43,cinder:UPDATE=41,cinder:DELETE=8,cinder:INSERT=13 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a9e42442-486c-4295-93a2-276eb5ccc5f5 tempest-VolumesSnapshotTestJSON-607027352 None] Created reservations ['0dd950fb-8d18-4923-a7fa-d435bdb7b0a3', '1c236223-5da0-4b49-a174-bce8d77404a6', '5164b7c5-82d7-482e-a9e5-e879a4d7c3a3', 'a5156744-3142-4da5-ac8d-666744c2a598'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a9e42442-486c-4295-93a2-276eb5ccc5f5 tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a9e42442-486c-4295-93a2-276eb5ccc5f5 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a9e42442-486c-4295-93a2-276eb5ccc5f5 tempest-VolumesSnapshotTestJSON-607027352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a9e42442-486c-4295-93a2-276eb5ccc5f5 tempest-VolumesSnapshotTestJSON-607027352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a9e42442-486c-4295-93a2-276eb5ccc5f5 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a9e42442-486c-4295-93a2-276eb5ccc5f5 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:14 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:16:14 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-f05eb475-c564-45be-8207-b4867c89be68-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-f05eb475-c564-45be-8207-b4867c89be68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-quobyte-bc0f3619-b5dd-4671-8926-57ea24b9e207" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-bc0f3619-b5dd-4671-8926-57ea24b9e207" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-quobyte-f05eb475-c564-45be-8207-b4867c89be68" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:14 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a9e42442-486c-4295-93a2-276eb5ccc5f5 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.294s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-a9e42442-486c-4295-93a2-276eb5ccc5f5 tempest-VolumesSnapshotTestJSON-607027352 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:16:14 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a9e42442-486c-4295-93a2-276eb5ccc5f5 tempest-VolumesSnapshotTestJSON-607027352 None] Deleted volume successfully. Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-f05eb475-c564-45be-8207-b4867c89be68" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] Deleting offline snapshot f05eb475-c564-45be-8207-b4867c89be68 of volume bc0f3619-b5dd-4671-8926-57ea24b9e207 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] snapshot_file for this snap is: volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a9e42442-486c-4295-93a2-276eb5ccc5f5 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-19e89f1e-7941-49e7-922a-d4ff86faa485-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a654a84-b23b-4a7a-abdd-e1b06aaddb91]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:14 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68 Sep 01 12:16:14 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:15 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68" returned: 0 in 0.442s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc0f3619-b5dd-4671-8926-57ea24b9e207(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:16:15 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff1ff54-5de8-4994-acbb-e3ac8fb5eb35]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:15 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 Sep 01 12:16:15 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-938f1af4-5d43-4d75-9ca4-c0de27dddc2e req-18bf8de1-e3d0-4fe8-877d-6679ae99cce6 tempest-AttachVolumeNegativeTest-36464837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-938f1af4-5d43-4d75-9ca4-c0de27dddc2e req-18bf8de1-e3d0-4fe8-877d-6679ae99cce6 tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-938f1af4-5d43-4d75-9ca4-c0de27dddc2e req-18bf8de1-e3d0-4fe8-877d-6679ae99cce6 tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-938f1af4-5d43-4d75-9ca4-c0de27dddc2e req-18bf8de1-e3d0-4fe8-877d-6679ae99cce6 tempest-AttachVolumeNegativeTest-36464837 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4566be89-c648-4339-91e0-0025a41e5a5c', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:16:15 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-938f1af4-5d43-4d75-9ca4-c0de27dddc2e req-18bf8de1-e3d0-4fe8-877d-6679ae99cce6 tempest-AttachVolumeNegativeTest-36464837 None] attachment_update completed successfully. Sep 01 12:16:15 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207" returned: 0 in 0.630s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:15 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68 Sep 01 12:16:15 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:16 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68" returned: 0 in 0.404s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:16 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68 Sep 01 12:16:16 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:16 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207.f05eb475-c564-45be-8207-b4867c89be68" returned: 0 in 0.285s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-f05eb475-c564-45be-8207-b4867c89be68" released by "_delete_snapshot" :: held 1.891s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-bc0f3619-b5dd-4671-8926-57ea24b9e207" released by "delete_snapshot" :: held 1.940s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:16 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] Created reservations ['35722f45-97af-475e-a533-82d5c31e68c3', '5569e1ee-83e6-437b-adae-4c2fa73e8f82', '5fad0ffb-6690-49fe-8fd8-76cde4cad1dc', '5ddb348a-8e73-4961-8243-cef3892d94c7'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:16:16 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] Delete snapshot completed successfully. Sep 01 12:16:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4a560482-98e8-46aa-b96b-4cc09b53fa44 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-f05eb475-c564-45be-8207-b4867c89be68-delete_snapshot" released by "delete_snapshot" :: held 2.120s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a687ff98-eb26-4235-86c2-315c14001b6a tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-bc0f3619-b5dd-4671-8926-57ea24b9e207-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a687ff98-eb26-4235-86c2-315c14001b6a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-bc0f3619-b5dd-4671-8926-57ea24b9e207-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a687ff98-eb26-4235-86c2-315c14001b6a tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-quobyte-bc0f3619-b5dd-4671-8926-57ea24b9e207" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a687ff98-eb26-4235-86c2-315c14001b6a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-bc0f3619-b5dd-4671-8926-57ea24b9e207" acquired by "delete_volume" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:17 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf38e1b-87c2-4a7e-91e8-514e1d88b7b5]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a687ff98-eb26-4235-86c2-315c14001b6a tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:17 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 Sep 01 12:16:17 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:17 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=58,cinder:SELECT=68,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:16:17 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-16d938a1-8b28-4751-a51a-dd52705172f7 req-50ad230b-56df-4de1-b30a-23b6f5c0d579 tempest-AttachVolumeNegativeTest-36464837 None] Terminate volume connection completed successfully. Sep 01 12:16:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-16d938a1-8b28-4751-a51a-dd52705172f7 req-50ad230b-56df-4de1-b30a-23b6f5c0d579 tempest-AttachVolumeNegativeTest-36464837 None] Deleting attachment 4566be89-c648-4339-91e0-0025a41e5a5c. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:16:17 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a687ff98-eb26-4235-86c2-315c14001b6a tempest-VolumesSnapshotTestJSON-607027352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207" returned: 0 in 0.432s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a687ff98-eb26-4235-86c2-315c14001b6a tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:17 devstack sudo[99394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207 Sep 01 12:16:17 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:17 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a687ff98-eb26-4235-86c2-315c14001b6a tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc0f3619-b5dd-4671-8926-57ea24b9e207" returned: 0 in 0.269s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a687ff98-eb26-4235-86c2-315c14001b6a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-bc0f3619-b5dd-4671-8926-57ea24b9e207" released by "delete_volume" :: held 0.765s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:17 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a687ff98-eb26-4235-86c2-315c14001b6a tempest-VolumesSnapshotTestJSON-607027352 None] Created reservations ['27e65cd1-7465-4942-b016-d1f51e08e6f5', '10cd234a-3ab2-4b0c-a28d-27d778b98b37', '99e4738a-e6b6-44ee-bbe8-86279c4d8435', 'b3a99d51-ebff-4f9c-a645-fff6af414640'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:16:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a687ff98-eb26-4235-86c2-315c14001b6a tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a687ff98-eb26-4235-86c2-315c14001b6a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a687ff98-eb26-4235-86c2-315c14001b6a tempest-VolumesSnapshotTestJSON-607027352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a687ff98-eb26-4235-86c2-315c14001b6a tempest-VolumesSnapshotTestJSON-607027352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a687ff98-eb26-4235-86c2-315c14001b6a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a687ff98-eb26-4235-86c2-315c14001b6a tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:18 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:16:18 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:18 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a687ff98-eb26-4235-86c2-315c14001b6a tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.321s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:18 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-a687ff98-eb26-4235-86c2-315c14001b6a tempest-VolumesSnapshotTestJSON-607027352 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:16:18 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a687ff98-eb26-4235-86c2-315c14001b6a tempest-VolumesSnapshotTestJSON-607027352 None] Deleted volume successfully. Sep 01 12:16:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a687ff98-eb26-4235-86c2-315c14001b6a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-bc0f3619-b5dd-4671-8926-57ea24b9e207-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Flow 'volume_create_manager' (1bb85b64-c5a8-49ae-9924-711734b52fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7118a70-8910-409d-bef0-4a07f91d5acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7118a70-8910-409d-bef0-4a07f91d5acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1538595780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf6fcf3-5d12-4299-adc0-4e81d5b74a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887183f04898416bb6d0e0d14c5afe2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:16:19Z,use_quota=True,user_id='5a95aaa9132d418f9af74530431b6c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4a0ac0-a315-49c0-af10-613878f374be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4a0ac0-a315-49c0-af10-613878f374be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c49938-f4a7-4485-b32f-d6ef62c3ebd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c49938-f4a7-4485-b32f-d6ef62c3ebd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddf6fcf3-5d12-4299-adc0-4e81d5b74a91', 'volume_name': 'volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cb45fa-0cdf-4966-ade6-d4035b4b7416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cb45fa-0cdf-4966-ade6-d4035b4b7416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cc8ce9-b77e-4c28-a020-189712cf6dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:19 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Volume ddf6fcf3-5d12-4299-adc0-4e81d5b74a91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91', 'volume_size': 1} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1538595780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf6fcf3-5d12-4299-adc0-4e81d5b74a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887183f04898416bb6d0e0d14c5afe2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:16:19Z,use_quota=True,user_id='5a95aaa9132d418f9af74530431b6c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Creating volume ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:16:19 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:19 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 1073741824 Sep 01 12:16:19 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:19 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 1073741824" returned: 0 in 0.625s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:19 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 Sep 01 12:16:19 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:20 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91" returned: 0 in 0.333s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:16:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cc8ce9-b77e-4c28-a020-189712cf6dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a785364a-fff4-43a5-a18a-038422cfac74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:20 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Volume volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 (ddf6fcf3-5d12-4299-adc0-4e81d5b74a91): created successfully Sep 01 12:16:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a785364a-fff4-43a5-a18a-038422cfac74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Flow 'volume_create_manager' (1bb85b64-c5a8-49ae-9924-711734b52fa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:16:20 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-18a1c9c4-1332-4518-8a89-2b18ca9de166 tempest-VolumesSnapshotTestJSON-607027352 None] Created volume successfully. Sep 01 12:16:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-576f9364-fd2d-426a-8bc0-9861fbb88037 tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-576f9364-fd2d-426a-8bc0-9861fbb88037 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-576f9364-fd2d-426a-8bc0-9861fbb88037 tempest-VolumesSnapshotTestJSON-607027352 None] Creating offline snapshot cef68f11-ba20-4360-ad0b-09e848a6f9b8 of volume ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:16:21 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f216050-cdf8-4a4e-94d9-519403e9d6a3]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-576f9364-fd2d-426a-8bc0-9861fbb88037 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:21 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 Sep 01 12:16:21 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:21 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-576f9364-fd2d-426a-8bc0-9861fbb88037 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91" returned: 0 in 0.489s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-576f9364-fd2d-426a-8bc0-9861fbb88037 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:21 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8 1G Sep 01 12:16:21 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:22 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-576f9364-fd2d-426a-8bc0-9861fbb88037 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8 1G" returned: 0 in 0.432s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-576f9364-fd2d-426a-8bc0-9861fbb88037 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:22 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8 Sep 01 12:16:22 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8123cd35-a17c-4a13-bb8a-15a8f1b2649f tempest-AttachVolumeNegativeTest-36464837 None] Acquiring lock "cinder-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8123cd35-a17c-4a13-bb8a-15a8f1b2649f tempest-AttachVolumeNegativeTest-36464837 None] Lock "cinder-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8123cd35-a17c-4a13-bb8a-15a8f1b2649f tempest-AttachVolumeNegativeTest-36464837 None] Acquiring lock "cinder-quobyte-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8123cd35-a17c-4a13-bb8a-15a8f1b2649f tempest-AttachVolumeNegativeTest-36464837 None] Lock "cinder-quobyte-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:22 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[58416c7d-bc12-40da-b193-c068fcd6346e]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8123cd35-a17c-4a13-bb8a-15a8f1b2649f tempest-AttachVolumeNegativeTest-36464837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:22 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-576f9364-fd2d-426a-8bc0-9861fbb88037 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8" returned: 0 in 0.381s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:22 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-576f9364-fd2d-426a-8bc0-9861fbb88037 tempest-VolumesSnapshotTestJSON-607027352 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8 is being set with open permissions: ugo+rw Sep 01 12:16:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-576f9364-fd2d-426a-8bc0-9861fbb88037 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:22 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add Sep 01 12:16:22 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:22 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8 Sep 01 12:16:22 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:22 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-576f9364-fd2d-426a-8bc0-9861fbb88037 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8" returned: 0 in 0.247s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:22 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8123cd35-a17c-4a13-bb8a-15a8f1b2649f tempest-AttachVolumeNegativeTest-36464837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add" returned: 0 in 0.391s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8123cd35-a17c-4a13-bb8a-15a8f1b2649f tempest-AttachVolumeNegativeTest-36464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-576f9364-fd2d-426a-8bc0-9861fbb88037 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:22 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add Sep 01 12:16:22 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:22 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.info Sep 01 12:16:22 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:23 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8123cd35-a17c-4a13-bb8a-15a8f1b2649f tempest-AttachVolumeNegativeTest-36464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add" returned: 0 in 0.256s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8123cd35-a17c-4a13-bb8a-15a8f1b2649f tempest-AttachVolumeNegativeTest-36464837 None] Lock "cinder-quobyte-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add" released by "delete_volume" :: held 0.708s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:23 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-576f9364-fd2d-426a-8bc0-9861fbb88037 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.info" returned: 0 in 0.295s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:23 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-576f9364-fd2d-426a-8bc0-9861fbb88037 tempest-VolumesSnapshotTestJSON-607027352 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.info is being set with open permissions: ugo+rw Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-576f9364-fd2d-426a-8bc0-9861fbb88037 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:23 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.info Sep 01 12:16:23 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-8123cd35-a17c-4a13-bb8a-15a8f1b2649f tempest-AttachVolumeNegativeTest-36464837 None] Created reservations ['37276b76-1a0e-4b8e-8ee3-b35e9071dfd2', '4ff7a6aa-107f-46af-9022-d6623907a144', '96eb69b1-c3ed-424f-b3ec-be9b7963c84a', '4969f694-a93e-48c0-8e1c-ec8ebcbcf61c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8123cd35-a17c-4a13-bb8a-15a8f1b2649f tempest-AttachVolumeNegativeTest-36464837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8123cd35-a17c-4a13-bb8a-15a8f1b2649f tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8123cd35-a17c-4a13-bb8a-15a8f1b2649f tempest-AttachVolumeNegativeTest-36464837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8123cd35-a17c-4a13-bb8a-15a8f1b2649f tempest-AttachVolumeNegativeTest-36464837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8123cd35-a17c-4a13-bb8a-15a8f1b2649f tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8123cd35-a17c-4a13-bb8a-15a8f1b2649f tempest-AttachVolumeNegativeTest-36464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:23 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:16:23 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:23 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-576f9364-fd2d-426a-8bc0-9861fbb88037 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.info" returned: 0 in 0.330s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-576f9364-fd2d-426a-8bc0-9861fbb88037 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.290s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-576f9364-fd2d-426a-8bc0-9861fbb88037 tempest-VolumesSnapshotTestJSON-607027352 None] Create snapshot completed successfully Sep 01 12:16:23 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8123cd35-a17c-4a13-bb8a-15a8f1b2649f tempest-AttachVolumeNegativeTest-36464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.274s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-8123cd35-a17c-4a13-bb8a-15a8f1b2649f tempest-AttachVolumeNegativeTest-36464837 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:16:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8123cd35-a17c-4a13-bb8a-15a8f1b2649f tempest-AttachVolumeNegativeTest-36464837 None] Deleted volume successfully. Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8123cd35-a17c-4a13-bb8a-15a8f1b2649f tempest-AttachVolumeNegativeTest-36464837 None] Lock "cinder-ecfd8ca8-5469-4ea7-b3cf-8de2b9526add-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f4650a71-cc4b-4999-9e49-7153672b96fa tempest-AttachVolumeNegativeTest-36464837 None] Acquiring lock "cinder-db4f4159-a7e9-4d29-bb73-ed754317eee3-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f4650a71-cc4b-4999-9e49-7153672b96fa tempest-AttachVolumeNegativeTest-36464837 None] Lock "cinder-db4f4159-a7e9-4d29-bb73-ed754317eee3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f4650a71-cc4b-4999-9e49-7153672b96fa tempest-AttachVolumeNegativeTest-36464837 None] Acquiring lock "cinder-quobyte-db4f4159-a7e9-4d29-bb73-ed754317eee3" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f4650a71-cc4b-4999-9e49-7153672b96fa tempest-AttachVolumeNegativeTest-36464837 None] Lock "cinder-quobyte-db4f4159-a7e9-4d29-bb73-ed754317eee3" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[440dbe40-db41-4212-9ffe-41fcb1d99ea9]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4650a71-cc4b-4999-9e49-7153672b96fa tempest-AttachVolumeNegativeTest-36464837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-db4f4159-a7e9-4d29-bb73-ed754317eee3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:23 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-db4f4159-a7e9-4d29-bb73-ed754317eee3 Sep 01 12:16:23 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:24 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4650a71-cc4b-4999-9e49-7153672b96fa tempest-AttachVolumeNegativeTest-36464837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-db4f4159-a7e9-4d29-bb73-ed754317eee3" returned: 0 in 0.340s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4650a71-cc4b-4999-9e49-7153672b96fa tempest-AttachVolumeNegativeTest-36464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-db4f4159-a7e9-4d29-bb73-ed754317eee3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:24 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-db4f4159-a7e9-4d29-bb73-ed754317eee3 Sep 01 12:16:24 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:24 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4650a71-cc4b-4999-9e49-7153672b96fa tempest-AttachVolumeNegativeTest-36464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-db4f4159-a7e9-4d29-bb73-ed754317eee3" returned: 0 in 0.279s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f4650a71-cc4b-4999-9e49-7153672b96fa tempest-AttachVolumeNegativeTest-36464837 None] Lock "cinder-quobyte-db4f4159-a7e9-4d29-bb73-ed754317eee3" released by "delete_volume" :: held 0.665s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:24 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-f4650a71-cc4b-4999-9e49-7153672b96fa tempest-AttachVolumeNegativeTest-36464837 None] Created reservations ['c99b53d3-49e7-41cb-ba7d-0e14582962fa', 'f92eed9c-ba49-4878-af28-e6a93f47e5e0', '4b91f3f9-bd91-4aad-9d57-cf1302e085c3', 'd07f3047-52c9-46d0-8096-4da014e4952d'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:16:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f4650a71-cc4b-4999-9e49-7153672b96fa tempest-AttachVolumeNegativeTest-36464837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f4650a71-cc4b-4999-9e49-7153672b96fa tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f4650a71-cc4b-4999-9e49-7153672b96fa tempest-AttachVolumeNegativeTest-36464837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f4650a71-cc4b-4999-9e49-7153672b96fa tempest-AttachVolumeNegativeTest-36464837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f4650a71-cc4b-4999-9e49-7153672b96fa tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4650a71-cc4b-4999-9e49-7153672b96fa tempest-AttachVolumeNegativeTest-36464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:24 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:16:24 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:24 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4650a71-cc4b-4999-9e49-7153672b96fa tempest-AttachVolumeNegativeTest-36464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.245s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:24 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-f4650a71-cc4b-4999-9e49-7153672b96fa tempest-AttachVolumeNegativeTest-36464837 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:16:24 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f4650a71-cc4b-4999-9e49-7153672b96fa tempest-AttachVolumeNegativeTest-36464837 None] Deleted volume successfully. Sep 01 12:16:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f4650a71-cc4b-4999-9e49-7153672b96fa tempest-AttachVolumeNegativeTest-36464837 None] Lock "cinder-db4f4159-a7e9-4d29-bb73-ed754317eee3-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:24 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:16:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Flow 'volume_create_manager' (a8753e75-646b-428a-89d1-13ae0a234158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968bb0ad-f51d-4100-a4e1-13a56933c568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968bb0ad-f51d-4100-a4e1-13a56933c568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-424330764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c6e28e1-05f0-4527-bdda-b6fb7efe14d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887183f04898416bb6d0e0d14c5afe2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cef68f11-ba20-4360-ad0b-09e848a6f9b8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:16:25Z,use_quota=True,user_id='5a95aaa9132d418f9af74530431b6c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c88714-e635-46dd-a8f1-d6cd218337b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c88714-e635-46dd-a8f1-d6cd218337b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736e29fa-72ea-4573-bcb9-4204ffafbfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736e29fa-72ea-4573-bcb9-4204ffafbfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1c6e28e1-05f0-4527-bdda-b6fb7efe14d7', 'volume_name': 'volume-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7', 'volume_size': 1, 'snapshot_id': 'cef68f11-ba20-4360-ad0b-09e848a6f9b8'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce92593-e786-4319-970a-793af29b3a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce92593-e786-4319-970a-793af29b3a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf4a05d-d9fd-4473-bd2f-8092ef7a83ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:25 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Volume 1c6e28e1-05f0-4527-bdda-b6fb7efe14d7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7', 'volume_size': 1, 'snapshot_id': 'cef68f11-ba20-4360-ad0b-09e848a6f9b8'} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4928be78-1cd1-43ad-830f-74f4b488d245 tempest-AttachVolumeNegativeTest-36464837 None] Acquiring lock "cinder-d25ff4b9-042b-4833-8e7f-d6cd18d6861c-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-quobyte-cef68f11-ba20-4360-ad0b-09e848a6f9b8-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7" by "_create_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4928be78-1cd1-43ad-830f-74f4b488d245 tempest-AttachVolumeNegativeTest-36464837 None] Lock "cinder-d25ff4b9-042b-4833-8e7f-d6cd18d6861c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-cef68f11-ba20-4360-ad0b-09e848a6f9b8-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Creating volume 1c6e28e1-05f0-4527-bdda-b6fb7efe14d7 from snapshot cef68f11-ba20-4360-ad0b-09e848a6f9b8 {{(pid=87084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-quobyte-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] snapshot: cef68f11-ba20-4360-ad0b-09e848a6f9b8, volume: 1c6e28e1-05f0-4527-bdda-b6fb7efe14d7, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4928be78-1cd1-43ad-830f-74f4b488d245 tempest-AttachVolumeNegativeTest-36464837 None] Acquiring lock "cinder-quobyte-d25ff4b9-042b-4833-8e7f-d6cd18d6861c" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6574df2-ba02-468c-9570-125ba5933490]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4928be78-1cd1-43ad-830f-74f4b488d245 tempest-AttachVolumeNegativeTest-36464837 None] Lock "cinder-quobyte-d25ff4b9-042b-4833-8e7f-d6cd18d6861c" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fed71d-603e-4de8-a4f4-a94e370a5583]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4928be78-1cd1-43ad-830f-74f4b488d245 tempest-AttachVolumeNegativeTest-36464837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d25ff4b9-042b-4833-8e7f-d6cd18d6861c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:25 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8 Sep 01 12:16:25 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:25 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d25ff4b9-042b-4833-8e7f-d6cd18d6861c Sep 01 12:16:25 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:25 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8" returned: 0 in 0.359s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca89e1d-047b-4c86-bb3b-75cdf2f8b5c7]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:25 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4928be78-1cd1-43ad-830f-74f4b488d245 tempest-AttachVolumeNegativeTest-36464837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d25ff4b9-042b-4833-8e7f-d6cd18d6861c" returned: 0 in 0.352s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4928be78-1cd1-43ad-830f-74f4b488d245 tempest-AttachVolumeNegativeTest-36464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d25ff4b9-042b-4833-8e7f-d6cd18d6861c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:25 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d25ff4b9-042b-4833-8e7f-d6cd18d6861c Sep 01 12:16:25 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:25 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 Sep 01 12:16:25 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:25 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4928be78-1cd1-43ad-830f-74f4b488d245 tempest-AttachVolumeNegativeTest-36464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d25ff4b9-042b-4833-8e7f-d6cd18d6861c" returned: 0 in 0.238s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4928be78-1cd1-43ad-830f-74f4b488d245 tempest-AttachVolumeNegativeTest-36464837 None] Lock "cinder-quobyte-d25ff4b9-042b-4833-8e7f-d6cd18d6861c" released by "delete_volume" :: held 0.631s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-4928be78-1cd1-43ad-830f-74f4b488d245 tempest-AttachVolumeNegativeTest-36464837 None] Created reservations ['6ac8afd2-fa16-4882-9e54-bddcd7e3a8c9', '0d1f9083-67aa-498d-8d4b-0e430b51afbd', '1b37b298-c04b-4c6d-87ee-4e2cf2b66f8f', 'e8503f68-0459-4013-886c-fd8076490ef5'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:16:25 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91" returned: 0 in 0.383s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Path /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7 not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4928be78-1cd1-43ad-830f-74f4b488d245 tempest-AttachVolumeNegativeTest-36464837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4928be78-1cd1-43ad-830f-74f4b488d245 tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4928be78-1cd1-43ad-830f-74f4b488d245 tempest-AttachVolumeNegativeTest-36464837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4928be78-1cd1-43ad-830f-74f4b488d245 tempest-AttachVolumeNegativeTest-36464837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4928be78-1cd1-43ad-830f-74f4b488d245 tempest-AttachVolumeNegativeTest-36464837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4928be78-1cd1-43ad-830f-74f4b488d245 tempest-AttachVolumeNegativeTest-36464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:25 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7 Sep 01 12:16:25 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:25 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:16:25 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:26 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4928be78-1cd1-43ad-830f-74f4b488d245 tempest-AttachVolumeNegativeTest-36464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.269s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:26 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-4928be78-1cd1-43ad-830f-74f4b488d245 tempest-AttachVolumeNegativeTest-36464837 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:16:26 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4928be78-1cd1-43ad-830f-74f4b488d245 tempest-AttachVolumeNegativeTest-36464837 None] Deleted volume successfully. Sep 01 12:16:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4928be78-1cd1-43ad-830f-74f4b488d245 tempest-AttachVolumeNegativeTest-36464837 None] Lock "cinder-d25ff4b9-042b-4833-8e7f-d6cd18d6861c-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:31 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7" returned: 0 in 5.509s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:31 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91, size 1024.00 MB, duration 5.51 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:16:31 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Converted 1024.00 MB image at 185.76 MB/s Sep 01 12:16:31 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7 is being set with open permissions: ugo+rw Sep 01 12:16:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:31 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7 Sep 01 12:16:31 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:31 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7" returned: 0 in 0.345s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7" released by "_copy_volume_from_snapshot" :: held 6.685s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-cef68f11-ba20-4360-ad0b-09e848a6f9b8-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7" released by "_create_volume_from_snapshot" :: held 6.792s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.813s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf4a05d-d9fd-4473-bd2f-8092ef7a83ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7', 'volume_size': 1, 'snapshot_id': 'cef68f11-ba20-4360-ad0b-09e848a6f9b8'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2754da2d-bd11-4017-a062-fcbda60be606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:31 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Volume volume-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7 (1c6e28e1-05f0-4527-bdda-b6fb7efe14d7): created successfully Sep 01 12:16:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2754da2d-bd11-4017-a062-fcbda60be606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Flow 'volume_create_manager' (a8753e75-646b-428a-89d1-13ae0a234158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:16:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2aa04f81-7bdf-4301-b68d-e7fbda6c87df tempest-VolumesSnapshotTestJSON-607027352 None] Created volume successfully. Sep 01 12:16:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ea228838-3127-479b-9ccc-6e335231efbd tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ea228838-3127-479b-9ccc-6e335231efbd tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ea228838-3127-479b-9ccc-6e335231efbd tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-quobyte-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:33 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ea228838-3127-479b-9ccc-6e335231efbd tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:33 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa45cf0a-8a4b-49ce-bb18-6a789b96927c]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea228838-3127-479b-9ccc-6e335231efbd tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:33 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7 Sep 01 12:16:33 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:33 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea228838-3127-479b-9ccc-6e335231efbd tempest-VolumesSnapshotTestJSON-607027352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7" returned: 0 in 0.681s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea228838-3127-479b-9ccc-6e335231efbd tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-5eb41478-a307-4326-a1f2-af6bc7ef8434 req-50ec599d-9c8d-4e25-9176-452ce0d559d1 tempest-TestMinimumBasicScenario-2138008308 None] Terminate volume connection completed successfully. Sep 01 12:16:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-5eb41478-a307-4326-a1f2-af6bc7ef8434 req-50ec599d-9c8d-4e25-9176-452ce0d559d1 tempest-TestMinimumBasicScenario-2138008308 None] Deleting attachment 5d8fbf20-57ee-48d4-a188-b143b47c4024. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:16:33 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7 Sep 01 12:16:33 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:34 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea228838-3127-479b-9ccc-6e335231efbd tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7" returned: 0 in 0.376s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ea228838-3127-479b-9ccc-6e335231efbd tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7" released by "delete_volume" :: held 1.111s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:34 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-ea228838-3127-479b-9ccc-6e335231efbd tempest-VolumesSnapshotTestJSON-607027352 None] Created reservations ['b88c0698-223d-4440-b6b9-1235f339d385', '8bb064bf-bae8-47ae-a6c1-4c40418e168a', '265fc0c6-12e9-4b24-85ab-59abd9c441d6', '25552dbf-bd10-4906-b70d-326c8904019a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:16:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ea228838-3127-479b-9ccc-6e335231efbd tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ea228838-3127-479b-9ccc-6e335231efbd tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ea228838-3127-479b-9ccc-6e335231efbd tempest-VolumesSnapshotTestJSON-607027352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ea228838-3127-479b-9ccc-6e335231efbd tempest-VolumesSnapshotTestJSON-607027352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ea228838-3127-479b-9ccc-6e335231efbd tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea228838-3127-479b-9ccc-6e335231efbd tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:34 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:16:34 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:34 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ea228838-3127-479b-9ccc-6e335231efbd tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.327s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:34 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-ea228838-3127-479b-9ccc-6e335231efbd tempest-VolumesSnapshotTestJSON-607027352 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:16:34 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ea228838-3127-479b-9ccc-6e335231efbd tempest-VolumesSnapshotTestJSON-607027352 None] Deleted volume successfully. Sep 01 12:16:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ea228838-3127-479b-9ccc-6e335231efbd tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-1c6e28e1-05f0-4527-bdda-b6fb7efe14d7-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-79449f60-0779-4285-9eb6-ab759b300f1c tempest-TestMinimumBasicScenario-2138008308 None] Acquiring lock "cinder-ac190fbf-7f39-4860-89af-88b9eab4c997-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-79449f60-0779-4285-9eb6-ab759b300f1c tempest-TestMinimumBasicScenario-2138008308 None] Lock "cinder-ac190fbf-7f39-4860-89af-88b9eab4c997-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-79449f60-0779-4285-9eb6-ab759b300f1c tempest-TestMinimumBasicScenario-2138008308 None] Acquiring lock "cinder-quobyte-ac190fbf-7f39-4860-89af-88b9eab4c997" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-79449f60-0779-4285-9eb6-ab759b300f1c tempest-TestMinimumBasicScenario-2138008308 None] Lock "cinder-quobyte-ac190fbf-7f39-4860-89af-88b9eab4c997" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:34 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c9ee15-8d54-4328-9470-5599ce2beccf]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-79449f60-0779-4285-9eb6-ab759b300f1c tempest-TestMinimumBasicScenario-2138008308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac190fbf-7f39-4860-89af-88b9eab4c997 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:34 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac190fbf-7f39-4860-89af-88b9eab4c997 Sep 01 12:16:34 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:35 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-79449f60-0779-4285-9eb6-ab759b300f1c tempest-TestMinimumBasicScenario-2138008308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac190fbf-7f39-4860-89af-88b9eab4c997" returned: 0 in 0.447s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-79449f60-0779-4285-9eb6-ab759b300f1c tempest-TestMinimumBasicScenario-2138008308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac190fbf-7f39-4860-89af-88b9eab4c997 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:35 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac190fbf-7f39-4860-89af-88b9eab4c997 Sep 01 12:16:35 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-cef68f11-ba20-4360-ad0b-09e848a6f9b8-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-cef68f11-ba20-4360-ad0b-09e848a6f9b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-quobyte-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-quobyte-cef68f11-ba20-4360-ad0b-09e848a6f9b8" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-cef68f11-ba20-4360-ad0b-09e848a6f9b8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] Deleting offline snapshot cef68f11-ba20-4360-ad0b-09e848a6f9b8 of volume ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] snapshot_file for this snap is: volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f53ced-6a9d-41ae-ab07-69f8ac2e4077]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:35 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8 Sep 01 12:16:35 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:35 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-79449f60-0779-4285-9eb6-ab759b300f1c tempest-TestMinimumBasicScenario-2138008308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac190fbf-7f39-4860-89af-88b9eab4c997" returned: 0 in 0.323s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-79449f60-0779-4285-9eb6-ab759b300f1c tempest-TestMinimumBasicScenario-2138008308 None] Lock "cinder-quobyte-ac190fbf-7f39-4860-89af-88b9eab4c997" released by "delete_volume" :: held 0.816s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-79449f60-0779-4285-9eb6-ab759b300f1c tempest-TestMinimumBasicScenario-2138008308 None] Created reservations ['a3e24a65-cda9-4a17-9c31-d7abe5fdcf3e', '239ee8e3-b03e-4d22-b945-f25f580ecd6c', '156d395a-aa68-4309-acf0-22afd0ba6e01', '5638130d-6cea-4989-9bda-6b6fb3d871bd'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-79449f60-0779-4285-9eb6-ab759b300f1c tempest-TestMinimumBasicScenario-2138008308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-79449f60-0779-4285-9eb6-ab759b300f1c tempest-TestMinimumBasicScenario-2138008308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-79449f60-0779-4285-9eb6-ab759b300f1c tempest-TestMinimumBasicScenario-2138008308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-79449f60-0779-4285-9eb6-ab759b300f1c tempest-TestMinimumBasicScenario-2138008308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-79449f60-0779-4285-9eb6-ab759b300f1c tempest-TestMinimumBasicScenario-2138008308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-79449f60-0779-4285-9eb6-ab759b300f1c tempest-TestMinimumBasicScenario-2138008308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:35 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:16:35 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:35 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8" returned: 0 in 0.399s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[057a4ff9-7b21-4d38-82cd-136d3f84560e]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:35 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 Sep 01 12:16:35 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:36 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-79449f60-0779-4285-9eb6-ab759b300f1c tempest-TestMinimumBasicScenario-2138008308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.375s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:36 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-79449f60-0779-4285-9eb6-ab759b300f1c tempest-TestMinimumBasicScenario-2138008308 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:16:36 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-79449f60-0779-4285-9eb6-ab759b300f1c tempest-TestMinimumBasicScenario-2138008308 None] Deleted volume successfully. Sep 01 12:16:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-79449f60-0779-4285-9eb6-ab759b300f1c tempest-TestMinimumBasicScenario-2138008308 None] Lock "cinder-ac190fbf-7f39-4860-89af-88b9eab4c997-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:36 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91" returned: 0 in 0.757s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:36 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8 Sep 01 12:16:36 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:37 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8" returned: 0 in 0.603s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:37 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8 Sep 01 12:16:37 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:37 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91.cef68f11-ba20-4360-ad0b-09e848a6f9b8" returned: 0 in 0.437s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-cef68f11-ba20-4360-ad0b-09e848a6f9b8" released by "_delete_snapshot" :: held 2.365s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91" released by "delete_snapshot" :: held 2.392s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:37 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] Created reservations ['c1fd4ad9-528d-4c3d-8548-d13f16527e1a', '8c785601-87f7-4095-9f42-9f4006780b03', 'cffd699f-c47c-4e9c-ba21-0f359c993ac6', '4c8bc885-3b48-4977-bf4e-8c719c0584b0'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:16:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] Delete snapshot completed successfully. Sep 01 12:16:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-39db7bcd-ecb3-49e6-b320-b1bd9ae57bc3 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-cef68f11-ba20-4360-ad0b-09e848a6f9b8-delete_snapshot" released by "delete_snapshot" :: held 2.584s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Flow 'volume_create_manager' (44a6e784-cc10-4e98-b3bf-cc566a19c607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20fe4c71-3aeb-4499-a0b4-771e1cf339d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20fe4c71-3aeb-4499-a0b4-771e1cf339d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-571036937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8ac1ce718a54b01b8f9fca93565c222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:16:38Z,use_quota=True,user_id='473f7b7a302a4c398f4e5f0058ff011f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab40f4ec-17ce-4dc0-9750-17a6f60aac6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab40f4ec-17ce-4dc0-9750-17a6f60aac6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf014352-48f3-46ae-8560-2ccd02105b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf014352-48f3-46ae-8560-2ccd02105b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb', 'volume_name': 'volume-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5856fb-6a18-4abe-913d-c41c7b6c5c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5856fb-6a18-4abe-913d-c41c7b6c5c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff412d70-1439-406f-bfe5-f1bc7ecccc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:38 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Volume 94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb', 'volume_size': 1} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-571036937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8ac1ce718a54b01b8f9fca93565c222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:16:38Z,use_quota=True,user_id='473f7b7a302a4c398f4e5f0058ff011f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Creating volume 94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:16:38 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:38 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb 1073741824 Sep 01 12:16:38 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1dc67b11-5bd3-4198-8154-8141ef285769 tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1dc67b11-5bd3-4198-8154-8141ef285769 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1dc67b11-5bd3-4198-8154-8141ef285769 tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-quobyte-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1dc67b11-5bd3-4198-8154-8141ef285769 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a64432-c01c-4375-be41-957f30e925ab]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1dc67b11-5bd3-4198-8154-8141ef285769 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:38 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 Sep 01 12:16:38 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-44ec89ef-de05-4d0a-a764-0d63eb8bc757 req-a3b4884e-230b-4750-9a86-78da9b21a83d tempest-TestServerVolumeAttachmentScenario-1121532767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:39 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb 1073741824" returned: 0 in 0.695s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:39 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1dc67b11-5bd3-4198-8154-8141ef285769 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91" returned: 0 in 0.520s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1dc67b11-5bd3-4198-8154-8141ef285769 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:39 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91 Sep 01 12:16:39 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:39 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb Sep 01 12:16:39 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:39 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb" returned: 0 in 0.254s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:39 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-44ec89ef-de05-4d0a-a764-0d63eb8bc757 req-a3b4884e-230b-4750-9a86-78da9b21a83d tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.368s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1dc67b11-5bd3-4198-8154-8141ef285769 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91" returned: 0 in 0.290s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1dc67b11-5bd3-4198-8154-8141ef285769 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91" released by "delete_volume" :: held 0.893s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-44ec89ef-de05-4d0a-a764-0d63eb8bc757 req-a3b4884e-230b-4750-9a86-78da9b21a83d tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff412d70-1439-406f-bfe5-f1bc7ecccc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aace179b-80c6-40bb-a44d-4fae8ffef8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-44ec89ef-de05-4d0a-a764-0d63eb8bc757 req-a3b4884e-230b-4750-9a86-78da9b21a83d tempest-TestServerVolumeAttachmentScenario-1121532767 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d341adb-f123-4a9c-99ea-e835977ff387', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-1dc67b11-5bd3-4198-8154-8141ef285769 tempest-VolumesSnapshotTestJSON-607027352 None] Created reservations ['984bf256-dc2f-44f1-96e1-b53a7c66294a', '54adc8d9-7fcc-4ecf-adb8-0ee2bf9e71ee', '8c9721d3-2a4e-45d3-a35b-2cc21c63554c', '95ea6c6c-fc9a-46c2-9af7-4e88e77ee3a5'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:16:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Volume volume-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb (94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb): created successfully Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aace179b-80c6-40bb-a44d-4fae8ffef8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Flow 'volume_create_manager' (44a6e784-cc10-4e98-b3bf-cc566a19c607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:16:39 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-354b30d7-7b5d-406d-8e17-c79e8eaefd0e tempest-VolumesTestJSON-545176951 None] Created volume successfully. Sep 01 12:16:39 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-44ec89ef-de05-4d0a-a764-0d63eb8bc757 req-a3b4884e-230b-4750-9a86-78da9b21a83d tempest-TestServerVolumeAttachmentScenario-1121532767 None] attachment_update completed successfully. Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1dc67b11-5bd3-4198-8154-8141ef285769 tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1dc67b11-5bd3-4198-8154-8141ef285769 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1dc67b11-5bd3-4198-8154-8141ef285769 tempest-VolumesSnapshotTestJSON-607027352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1dc67b11-5bd3-4198-8154-8141ef285769 tempest-VolumesSnapshotTestJSON-607027352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1dc67b11-5bd3-4198-8154-8141ef285769 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1dc67b11-5bd3-4198-8154-8141ef285769 tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:39 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:16:39 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:40 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1dc67b11-5bd3-4198-8154-8141ef285769 tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.327s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:40 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-1dc67b11-5bd3-4198-8154-8141ef285769 tempest-VolumesSnapshotTestJSON-607027352 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:16:40 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1dc67b11-5bd3-4198-8154-8141ef285769 tempest-VolumesSnapshotTestJSON-607027352 None] Deleted volume successfully. Sep 01 12:16:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1dc67b11-5bd3-4198-8154-8141ef285769 tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-ddf6fcf3-5d12-4299-adc0-4e81d5b74a91-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-713f98f4-b892-425a-8af4-4694eb23797a tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-e7adbf8c-15f4-4933-bf53-44b3be8b4833-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-713f98f4-b892-425a-8af4-4694eb23797a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-e7adbf8c-15f4-4933-bf53-44b3be8b4833-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-713f98f4-b892-425a-8af4-4694eb23797a tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "cinder-quobyte-e7adbf8c-15f4-4933-bf53-44b3be8b4833" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-713f98f4-b892-425a-8af4-4694eb23797a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-e7adbf8c-15f4-4933-bf53-44b3be8b4833" acquired by "delete_volume" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b26cd7-1757-44a0-a815-cd547ffce95f]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-713f98f4-b892-425a-8af4-4694eb23797a tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Flow 'volume_create_manager' (097a894d-4261-4bf1-8a2e-a1eed721fddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7dc5ab5-729f-470a-a7aa-32456f7d0226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:41 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833 Sep 01 12:16:41 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7dc5ab5-729f-470a-a7aa-32456f7d0226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1041625613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fcbcbd-5952-4622-bdce-b3d8b7ea06f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8ac1ce718a54b01b8f9fca93565c222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:16:41Z,use_quota=True,user_id='473f7b7a302a4c398f4e5f0058ff011f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804d2956-f74b-468e-89c3-9bacb7a2c0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804d2956-f74b-468e-89c3-9bacb7a2c0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed4ad05-4c62-4025-aa9f-9b0a51def75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed4ad05-4c62-4025-aa9f-9b0a51def75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94fcbcbd-5952-4622-bdce-b3d8b7ea06f9', 'volume_name': 'volume-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7619a7a7-4589-48d7-8098-aedaf799ebdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7619a7a7-4589-48d7-8098-aedaf799ebdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca7e8edb-a986-4607-8fab-126ce53f5412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Volume 94fcbcbd-5952-4622-bdce-b3d8b7ea06f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9', 'volume_size': 1} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1041625613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fcbcbd-5952-4622-bdce-b3d8b7ea06f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8ac1ce718a54b01b8f9fca93565c222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:16:41Z,use_quota=True,user_id='473f7b7a302a4c398f4e5f0058ff011f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Creating volume 94fcbcbd-5952-4622-bdce-b3d8b7ea06f9 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:16:41 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:41 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9 1073741824 Sep 01 12:16:41 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:41 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-713f98f4-b892-425a-8af4-4694eb23797a tempest-VolumesSnapshotTestJSON-607027352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833" returned: 0 in 0.452s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-713f98f4-b892-425a-8af4-4694eb23797a tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:41 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833 Sep 01 12:16:41 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:41 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:16:41 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:42 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-713f98f4-b892-425a-8af4-4694eb23797a tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e7adbf8c-15f4-4933-bf53-44b3be8b4833" returned: 0 in 0.324s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:42 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-713f98f4-b892-425a-8af4-4694eb23797a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-quobyte-e7adbf8c-15f4-4933-bf53-44b3be8b4833" released by "delete_volume" :: held 0.896s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9 1073741824" returned: 0 in 0.613s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:42 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9 Sep 01 12:16:42 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-713f98f4-b892-425a-8af4-4694eb23797a tempest-VolumesSnapshotTestJSON-607027352 None] Created reservations ['c8a1c61d-96f9-4078-8d1c-ce4e26ef616b', 'c9b53bfc-7384-4c0c-a4c2-5e8e60ef67d8', 'c92c8af3-3d9d-4edf-95ea-ef0a778e7ef2', 'b9b06c0c-6bbc-4e6d-8d8d-4a83ebfe44d4'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:16:42 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.436s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-713f98f4-b892-425a-8af4-4694eb23797a tempest-VolumesSnapshotTestJSON-607027352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-713f98f4-b892-425a-8af4-4694eb23797a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-713f98f4-b892-425a-8af4-4694eb23797a tempest-VolumesSnapshotTestJSON-607027352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-713f98f4-b892-425a-8af4-4694eb23797a tempest-VolumesSnapshotTestJSON-607027352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-713f98f4-b892-425a-8af4-4694eb23797a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-713f98f4-b892-425a-8af4-4694eb23797a tempest-VolumesSnapshotTestJSON-607027352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:42 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:16:42 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:42 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9" returned: 0 in 0.412s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca7e8edb-a986-4607-8fab-126ce53f5412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be05c3a-e824-4f88-b683-eb1d960b53bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:42 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Volume volume-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9 (94fcbcbd-5952-4622-bdce-b3d8b7ea06f9): created successfully Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be05c3a-e824-4f88-b683-eb1d960b53bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Flow 'volume_create_manager' (097a894d-4261-4bf1-8a2e-a1eed721fddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:16:42 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4d9195d7-9cd3-4dc8-a18e-d2afaf2bcee6 tempest-VolumesTestJSON-545176951 None] Created volume successfully. Sep 01 12:16:42 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-713f98f4-b892-425a-8af4-4694eb23797a tempest-VolumesSnapshotTestJSON-607027352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.302s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-713f98f4-b892-425a-8af4-4694eb23797a tempest-VolumesSnapshotTestJSON-607027352 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:16:42 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-713f98f4-b892-425a-8af4-4694eb23797a tempest-VolumesSnapshotTestJSON-607027352 None] Deleted volume successfully. Sep 01 12:16:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-713f98f4-b892-425a-8af4-4694eb23797a tempest-VolumesSnapshotTestJSON-607027352 None] Lock "cinder-e7adbf8c-15f4-4933-bf53-44b3be8b4833-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Flow 'volume_create_manager' (8dc242a5-4904-428e-a40a-1646dd9210e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d297002a-3b04-45fb-b266-421e2b362e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d297002a-3b04-45fb-b266-421e2b362e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1430827732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47968777-9f2b-4648-8d52-fee376e58488,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8ac1ce718a54b01b8f9fca93565c222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:16:44Z,use_quota=True,user_id='473f7b7a302a4c398f4e5f0058ff011f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afbafe4c-ddd6-4971-85c8-1c9eb0a47177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afbafe4c-ddd6-4971-85c8-1c9eb0a47177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a91e5a-386e-4a6e-831e-597aab946110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a91e5a-386e-4a6e-831e-597aab946110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47968777-9f2b-4648-8d52-fee376e58488', 'volume_name': 'volume-47968777-9f2b-4648-8d52-fee376e58488', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (508c643d-696c-4eb0-a345-d67dc35c3bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (508c643d-696c-4eb0-a345-d67dc35c3bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93cd42ab-1441-4f55-a795-53821767b887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:44 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Volume 47968777-9f2b-4648-8d52-fee376e58488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47968777-9f2b-4648-8d52-fee376e58488', 'volume_size': 1} Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1430827732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47968777-9f2b-4648-8d52-fee376e58488,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8ac1ce718a54b01b8f9fca93565c222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:16:44Z,use_quota=True,user_id='473f7b7a302a4c398f4e5f0058ff011f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Creating volume 47968777-9f2b-4648-8d52-fee376e58488 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:16:44 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-47968777-9f2b-4648-8d52-fee376e58488 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:44 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-47968777-9f2b-4648-8d52-fee376e58488 1073741824 Sep 01 12:16:44 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-72fe334d-872c-40c5-8b46-fa234ad924fe req-68105710-2516-4d83-a589-f42b0ef86e44 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:45 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-47968777-9f2b-4648-8d52-fee376e58488 1073741824" returned: 0 in 0.546s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-47968777-9f2b-4648-8d52-fee376e58488 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:45 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-47968777-9f2b-4648-8d52-fee376e58488 Sep 01 12:16:45 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:45 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-47968777-9f2b-4648-8d52-fee376e58488" returned: 0 in 0.310s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:16:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-72fe334d-872c-40c5-8b46-fa234ad924fe req-68105710-2516-4d83-a589-f42b0ef86e44 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.690s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93cd42ab-1441-4f55-a795-53821767b887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47968777-9f2b-4648-8d52-fee376e58488', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90ead1d-0d0a-4f23-8e17-a39ef07691cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:16:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-72fe334d-872c-40c5-8b46-fa234ad924fe req-68105710-2516-4d83-a589-f42b0ef86e44 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.073s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:45 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Volume volume-47968777-9f2b-4648-8d52-fee376e58488 (47968777-9f2b-4648-8d52-fee376e58488): created successfully Sep 01 12:16:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90ead1d-0d0a-4f23-8e17-a39ef07691cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:16:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Flow 'volume_create_manager' (8dc242a5-4904-428e-a40a-1646dd9210e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:16:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2dedea1b-5930-4b30-93c5-eef3d868de60 tempest-VolumesTestJSON-545176951 None] Created volume successfully. Sep 01 12:16:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-72fe334d-872c-40c5-8b46-fa234ad924fe req-68105710-2516-4d83-a589-f42b0ef86e44 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6df6043-ac2d-4241-a828-0c304cfd39f8', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:16:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-72fe334d-872c-40c5-8b46-fa234ad924fe req-68105710-2516-4d83-a589-f42b0ef86e44 tempest-TestServerVolumeAttachmentScenario-1121532767 None] attachment_update completed successfully. Sep 01 12:16:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-221a0ce4-bbb6-48f4-a009-4dbeb6610703 tempest-VolumesTestJSON-545176951 None] Acquiring lock "cinder-47968777-9f2b-4648-8d52-fee376e58488-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-221a0ce4-bbb6-48f4-a009-4dbeb6610703 tempest-VolumesTestJSON-545176951 None] Lock "cinder-47968777-9f2b-4648-8d52-fee376e58488-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-221a0ce4-bbb6-48f4-a009-4dbeb6610703 tempest-VolumesTestJSON-545176951 None] Acquiring lock "cinder-quobyte-47968777-9f2b-4648-8d52-fee376e58488" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-221a0ce4-bbb6-48f4-a009-4dbeb6610703 tempest-VolumesTestJSON-545176951 None] Lock "cinder-quobyte-47968777-9f2b-4648-8d52-fee376e58488" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:47 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba3cb4b-fce8-4496-99e5-8a7dad30bfe9]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-221a0ce4-bbb6-48f4-a009-4dbeb6610703 tempest-VolumesTestJSON-545176951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-47968777-9f2b-4648-8d52-fee376e58488 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:47 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-a2dff34e-0785-4fbf-9239-c66da814e6ca req-fdee47ac-95c2-4e14-ba69-62e44f671042 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Terminate volume connection completed successfully. Sep 01 12:16:47 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-a2dff34e-0785-4fbf-9239-c66da814e6ca req-fdee47ac-95c2-4e14-ba69-62e44f671042 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Deleting attachment d6df6043-ac2d-4241-a828-0c304cfd39f8. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:16:47 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-47968777-9f2b-4648-8d52-fee376e58488 Sep 01 12:16:47 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:48 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-221a0ce4-bbb6-48f4-a009-4dbeb6610703 tempest-VolumesTestJSON-545176951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-47968777-9f2b-4648-8d52-fee376e58488" returned: 0 in 0.570s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-221a0ce4-bbb6-48f4-a009-4dbeb6610703 tempest-VolumesTestJSON-545176951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-47968777-9f2b-4648-8d52-fee376e58488 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:48 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-47968777-9f2b-4648-8d52-fee376e58488 Sep 01 12:16:48 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:48 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-221a0ce4-bbb6-48f4-a009-4dbeb6610703 tempest-VolumesTestJSON-545176951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-47968777-9f2b-4648-8d52-fee376e58488" returned: 0 in 0.281s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-221a0ce4-bbb6-48f4-a009-4dbeb6610703 tempest-VolumesTestJSON-545176951 None] Lock "cinder-quobyte-47968777-9f2b-4648-8d52-fee376e58488" released by "delete_volume" :: held 0.921s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:48 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-221a0ce4-bbb6-48f4-a009-4dbeb6610703 tempest-VolumesTestJSON-545176951 None] Created reservations ['67a8c1df-c94e-406f-88ef-15bde96920cd', '8b32a112-ab40-43a4-ab3a-b922b18f8570', '4572929f-53b4-40fc-bdf4-7f3637799078', '1ee64e36-2c49-4d4b-af11-633ff062de0e'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:16:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-221a0ce4-bbb6-48f4-a009-4dbeb6610703 tempest-VolumesTestJSON-545176951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-221a0ce4-bbb6-48f4-a009-4dbeb6610703 tempest-VolumesTestJSON-545176951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-221a0ce4-bbb6-48f4-a009-4dbeb6610703 tempest-VolumesTestJSON-545176951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-221a0ce4-bbb6-48f4-a009-4dbeb6610703 tempest-VolumesTestJSON-545176951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-221a0ce4-bbb6-48f4-a009-4dbeb6610703 tempest-VolumesTestJSON-545176951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-221a0ce4-bbb6-48f4-a009-4dbeb6610703 tempest-VolumesTestJSON-545176951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:48 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:16:48 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:49 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-221a0ce4-bbb6-48f4-a009-4dbeb6610703 tempest-VolumesTestJSON-545176951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.385s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:49 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-221a0ce4-bbb6-48f4-a009-4dbeb6610703 tempest-VolumesTestJSON-545176951 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:16:49 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-221a0ce4-bbb6-48f4-a009-4dbeb6610703 tempest-VolumesTestJSON-545176951 None] Deleted volume successfully. Sep 01 12:16:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-221a0ce4-bbb6-48f4-a009-4dbeb6610703 tempest-VolumesTestJSON-545176951 None] Lock "cinder-47968777-9f2b-4648-8d52-fee376e58488-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:49 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-65ba19ed-ebbb-4255-a780-9ed15453a3d1 req-51dc91b4-9031-4bb8-9b9b-3b30af90731d tempest-TestServerVolumeAttachmentScenario-1121532767 None] Terminate volume connection completed successfully. Sep 01 12:16:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-65ba19ed-ebbb-4255-a780-9ed15453a3d1 req-51dc91b4-9031-4bb8-9b9b-3b30af90731d tempest-TestServerVolumeAttachmentScenario-1121532767 None] Deleting attachment 0d341adb-f123-4a9c-99ea-e835977ff387. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:16:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8935788e-c53c-479e-99ee-1bee980f6748 tempest-VolumesTestJSON-545176951 None] Acquiring lock "cinder-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8935788e-c53c-479e-99ee-1bee980f6748 tempest-VolumesTestJSON-545176951 None] Lock "cinder-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8935788e-c53c-479e-99ee-1bee980f6748 tempest-VolumesTestJSON-545176951 None] Acquiring lock "cinder-quobyte-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8935788e-c53c-479e-99ee-1bee980f6748 tempest-VolumesTestJSON-545176951 None] Lock "cinder-quobyte-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9" acquired by "delete_volume" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:49 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a618c45-f0c0-4425-acf2-1aaa51a1e30c]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8935788e-c53c-479e-99ee-1bee980f6748 tempest-VolumesTestJSON-545176951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:49 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9 Sep 01 12:16:49 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:50 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8935788e-c53c-479e-99ee-1bee980f6748 tempest-VolumesTestJSON-545176951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9" returned: 0 in 0.577s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8935788e-c53c-479e-99ee-1bee980f6748 tempest-VolumesTestJSON-545176951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:50 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9 Sep 01 12:16:50 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:50 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8935788e-c53c-479e-99ee-1bee980f6748 tempest-VolumesTestJSON-545176951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9" returned: 0 in 0.492s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8935788e-c53c-479e-99ee-1bee980f6748 tempest-VolumesTestJSON-545176951 None] Lock "cinder-quobyte-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9" released by "delete_volume" :: held 1.146s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:51 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-8935788e-c53c-479e-99ee-1bee980f6748 tempest-VolumesTestJSON-545176951 None] Created reservations ['f2022d26-2a1e-419c-b38b-e1c0354e662c', 'f6df6a65-d414-4ee8-9e28-edef7ff7f538', '4c2b1b2d-92a1-4553-9ef0-d858d1c293a7', '16a58329-fbb5-4328-b42f-c965c4be49a3'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:16:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8935788e-c53c-479e-99ee-1bee980f6748 tempest-VolumesTestJSON-545176951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8935788e-c53c-479e-99ee-1bee980f6748 tempest-VolumesTestJSON-545176951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8935788e-c53c-479e-99ee-1bee980f6748 tempest-VolumesTestJSON-545176951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8935788e-c53c-479e-99ee-1bee980f6748 tempest-VolumesTestJSON-545176951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8935788e-c53c-479e-99ee-1bee980f6748 tempest-VolumesTestJSON-545176951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8935788e-c53c-479e-99ee-1bee980f6748 tempest-VolumesTestJSON-545176951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:51 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:16:51 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:51 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8935788e-c53c-479e-99ee-1bee980f6748 tempest-VolumesTestJSON-545176951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.289s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:51 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-8935788e-c53c-479e-99ee-1bee980f6748 tempest-VolumesTestJSON-545176951 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:16:51 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8935788e-c53c-479e-99ee-1bee980f6748 tempest-VolumesTestJSON-545176951 None] Deleted volume successfully. Sep 01 12:16:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8935788e-c53c-479e-99ee-1bee980f6748 tempest-VolumesTestJSON-545176951 None] Lock "cinder-94fcbcbd-5952-4622-bdce-b3d8b7ea06f9-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f209d5be-759d-462b-babb-a06036fa7dc8 tempest-VolumesTestJSON-545176951 None] Acquiring lock "cinder-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f209d5be-759d-462b-babb-a06036fa7dc8 tempest-VolumesTestJSON-545176951 None] Lock "cinder-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f209d5be-759d-462b-babb-a06036fa7dc8 tempest-VolumesTestJSON-545176951 None] Acquiring lock "cinder-quobyte-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f209d5be-759d-462b-babb-a06036fa7dc8 tempest-VolumesTestJSON-545176951 None] Lock "cinder-quobyte-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:52 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[657c526a-27c9-4694-aa72-4e499a2be23e]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f209d5be-759d-462b-babb-a06036fa7dc8 tempest-VolumesTestJSON-545176951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:52 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb Sep 01 12:16:52 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:52 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f209d5be-759d-462b-babb-a06036fa7dc8 tempest-VolumesTestJSON-545176951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb" returned: 0 in 0.452s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f209d5be-759d-462b-babb-a06036fa7dc8 tempest-VolumesTestJSON-545176951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:52 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb Sep 01 12:16:52 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:52 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f209d5be-759d-462b-babb-a06036fa7dc8 tempest-VolumesTestJSON-545176951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb" returned: 0 in 0.294s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f209d5be-759d-462b-babb-a06036fa7dc8 tempest-VolumesTestJSON-545176951 None] Lock "cinder-quobyte-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb" released by "delete_volume" :: held 0.801s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:53 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-f209d5be-759d-462b-babb-a06036fa7dc8 tempest-VolumesTestJSON-545176951 None] Created reservations ['452eacdd-8dc8-48d3-8d91-2333a3895301', '5d7c0720-ed1a-4a6d-92a4-49f715fcbb13', 'ca282b23-a73f-4140-9fc4-8972abe36128', '4f38464b-cfef-4115-aeb3-1ab7c42ace39'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:16:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f209d5be-759d-462b-babb-a06036fa7dc8 tempest-VolumesTestJSON-545176951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f209d5be-759d-462b-babb-a06036fa7dc8 tempest-VolumesTestJSON-545176951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f209d5be-759d-462b-babb-a06036fa7dc8 tempest-VolumesTestJSON-545176951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f209d5be-759d-462b-babb-a06036fa7dc8 tempest-VolumesTestJSON-545176951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f209d5be-759d-462b-babb-a06036fa7dc8 tempest-VolumesTestJSON-545176951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f209d5be-759d-462b-babb-a06036fa7dc8 tempest-VolumesTestJSON-545176951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:53 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:16:53 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:53 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f209d5be-759d-462b-babb-a06036fa7dc8 tempest-VolumesTestJSON-545176951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.360s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-f209d5be-759d-462b-babb-a06036fa7dc8 tempest-VolumesTestJSON-545176951 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:16:53 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f209d5be-759d-462b-babb-a06036fa7dc8 tempest-VolumesTestJSON-545176951 None] Deleted volume successfully. Sep 01 12:16:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f209d5be-759d-462b-babb-a06036fa7dc8 tempest-VolumesTestJSON-545176951 None] Lock "cinder-94d11bb3-96d2-4ff5-9bc4-ba57295bdcfb-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8474f6b8-01a4-41b4-8560-43154189cb92 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Acquiring lock "cinder-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8474f6b8-01a4-41b4-8560-43154189cb92 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "cinder-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8474f6b8-01a4-41b4-8560-43154189cb92 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Acquiring lock "cinder-quobyte-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8474f6b8-01a4-41b4-8560-43154189cb92 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "cinder-quobyte-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:55 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa077236-9a04-4cbf-8fac-74c77674129b]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8474f6b8-01a4-41b4-8560-43154189cb92 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:55 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023 Sep 01 12:16:55 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:55 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8474f6b8-01a4-41b4-8560-43154189cb92 tempest-TestServerVolumeAttachmentScenario-1121532767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023" returned: 0 in 0.425s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8474f6b8-01a4-41b4-8560-43154189cb92 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:55 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023 Sep 01 12:16:55 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:55 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8474f6b8-01a4-41b4-8560-43154189cb92 tempest-TestServerVolumeAttachmentScenario-1121532767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023" returned: 0 in 0.259s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:55 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8474f6b8-01a4-41b4-8560-43154189cb92 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "cinder-quobyte-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023" released by "delete_volume" :: held 0.739s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:55 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-8474f6b8-01a4-41b4-8560-43154189cb92 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Created reservations ['ca970105-72eb-45f8-bc40-7c3a61f777fd', '410e5a33-e56b-4323-b7c5-0a877b7672ef', '5ece6e84-a75e-4bc1-9b2a-c3bb94518897', 'c1651470-cf0e-4884-825d-9a568160fab7'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:16:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8474f6b8-01a4-41b4-8560-43154189cb92 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8474f6b8-01a4-41b4-8560-43154189cb92 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8474f6b8-01a4-41b4-8560-43154189cb92 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8474f6b8-01a4-41b4-8560-43154189cb92 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8474f6b8-01a4-41b4-8560-43154189cb92 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8474f6b8-01a4-41b4-8560-43154189cb92 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:55 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:16:55 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-67648224-96a0-4519-9f9e-10736b94b5a1 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Acquiring lock "cinder-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-67648224-96a0-4519-9f9e-10736b94b5a1 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "cinder-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-67648224-96a0-4519-9f9e-10736b94b5a1 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Acquiring lock "cinder-quobyte-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:16:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-67648224-96a0-4519-9f9e-10736b94b5a1 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "cinder-quobyte-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:16:56 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd66857e-d26f-4361-b461-21f01c0e4942]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:16:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67648224-96a0-4519-9f9e-10736b94b5a1 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:56 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8474f6b8-01a4-41b4-8560-43154189cb92 tempest-TestServerVolumeAttachmentScenario-1121532767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.384s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:56 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-8474f6b8-01a4-41b4-8560-43154189cb92 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:16:56 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8474f6b8-01a4-41b4-8560-43154189cb92 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Deleted volume successfully. Sep 01 12:16:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8474f6b8-01a4-41b4-8560-43154189cb92 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "cinder-4b7a7640-a5a0-44ca-bc3b-0f3fb08a3023-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:56 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca Sep 01 12:16:56 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:56 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67648224-96a0-4519-9f9e-10736b94b5a1 tempest-TestServerVolumeAttachmentScenario-1121532767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca" returned: 0 in 0.472s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67648224-96a0-4519-9f9e-10736b94b5a1 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:56 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca Sep 01 12:16:56 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:57 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67648224-96a0-4519-9f9e-10736b94b5a1 tempest-TestServerVolumeAttachmentScenario-1121532767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca" returned: 0 in 0.310s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-67648224-96a0-4519-9f9e-10736b94b5a1 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "cinder-quobyte-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca" released by "delete_volume" :: held 0.833s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:16:57 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-67648224-96a0-4519-9f9e-10736b94b5a1 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Created reservations ['d3eec10e-962b-4877-8e6e-393ac78ad862', 'f9629523-92f7-4e24-800f-8cddacfa1a29', '3b3cc339-5243-4c0d-8e5b-82f28576d207', '6422dd48-d14b-48d5-9036-a80331926f0a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:16:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-67648224-96a0-4519-9f9e-10736b94b5a1 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:16:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-67648224-96a0-4519-9f9e-10736b94b5a1 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:16:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-67648224-96a0-4519-9f9e-10736b94b5a1 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:16:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-67648224-96a0-4519-9f9e-10736b94b5a1 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:16:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-67648224-96a0-4519-9f9e-10736b94b5a1 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:16:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67648224-96a0-4519-9f9e-10736b94b5a1 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:16:57 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:16:57 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:16:57 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Sep 01 12:16:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67648224-96a0-4519-9f9e-10736b94b5a1 tempest-TestServerVolumeAttachmentScenario-1121532767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.448s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:16:57 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-67648224-96a0-4519-9f9e-10736b94b5a1 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:16:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-67648224-96a0-4519-9f9e-10736b94b5a1 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Deleted volume successfully. Sep 01 12:16:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-67648224-96a0-4519-9f9e-10736b94b5a1 tempest-TestServerVolumeAttachmentScenario-1121532767 None] Lock "cinder-1d53cb8c-d611-4c19-83ac-9b4a2ec2a8ca-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:17:07 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=98,cinder:INSERT=29,cinder:UPDATE=123,cinder:DELETE=10 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:17:07 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:INSERT=37,cinder:UPDATE=146,cinder:SELECT=122,cinder:DELETE=9 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Flow 'volume_create_manager' (57364c52-5d33-4128-9585-c0feb6fc1f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87362e2f-bb30-4d87-ab6a-7fe22f24a85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87362e2f-bb30-4d87-ab6a-7fe22f24a85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-751849970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35a522ab-8735-4d71-bd64-da0204c19aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2afa50e6db504f4a8898560c906048e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:28Z,use_quota=True,user_id='64674987b11f457c9df9dbcd30b271e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24cf4320-1057-4e79-bdfe-89f7dd0faedb),volume_type_id=24cf4320-1057-4e79-bdfe-89f7dd0faedb)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52225a41-627c-434c-b35a-31ab10f8eac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52225a41-627c-434c-b35a-31ab10f8eac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7507699-b460-44ab-829a-858dc826dde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7507699-b460-44ab-829a-858dc826dde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35a522ab-8735-4d71-bd64-da0204c19aff', 'volume_name': 'volume-35a522ab-8735-4d71-bd64-da0204c19aff', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53f599b-4970-4f38-9c62-4076420deec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53f599b-4970-4f38-9c62-4076420deec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e0bb47-45cf-48c9-9424-629d2c9817ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:28 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Volume 35a522ab-8735-4d71-bd64-da0204c19aff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35a522ab-8735-4d71-bd64-da0204c19aff', 'volume_size': 1} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-751849970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35a522ab-8735-4d71-bd64-da0204c19aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2afa50e6db504f4a8898560c906048e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:28Z,use_quota=True,user_id='64674987b11f457c9df9dbcd30b271e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24cf4320-1057-4e79-bdfe-89f7dd0faedb),volume_type_id=24cf4320-1057-4e79-bdfe-89f7dd0faedb)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Creating volume 35a522ab-8735-4d71-bd64-da0204c19aff {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:17:28 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-35a522ab-8735-4d71-bd64-da0204c19aff 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:28 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-35a522ab-8735-4d71-bd64-da0204c19aff 1073741824 Sep 01 12:17:28 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Flow 'volume_create_manager' (d9a791a5-bab4-41cf-9c77-aa03b896598d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67c9cd8-2615-46d8-b76a-d1d2d2a8f0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67c9cd8-2615-46d8-b76a-d1d2d2a8f0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1748744391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=349a9c42-40c3-4789-827a-b6d8d81cb3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2afa50e6db504f4a8898560c906048e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:29Z,use_quota=True,user_id='64674987b11f457c9df9dbcd30b271e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d755a1ac-c488-4612-94e5-215622caaa95),volume_type_id=d755a1ac-c488-4612-94e5-215622caaa95)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4198f4ee-a929-421e-a9ec-5e7137c7f33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4198f4ee-a929-421e-a9ec-5e7137c7f33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc92ca6d-dc9c-4eaf-b148-d957ff3c8293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:29 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc92ca6d-dc9c-4eaf-b148-d957ff3c8293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '349a9c42-40c3-4789-827a-b6d8d81cb3b3', 'volume_name': 'volume-349a9c42-40c3-4789-827a-b6d8d81cb3b3', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99962937-cef5-43d8-8c09-aca1b44ac462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99962937-cef5-43d8-8c09-aca1b44ac462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed57c96-8acd-443b-ab50-74f4d1ed9a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:29 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Volume 349a9c42-40c3-4789-827a-b6d8d81cb3b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-349a9c42-40c3-4789-827a-b6d8d81cb3b3', 'volume_size': 1} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-35a522ab-8735-4d71-bd64-da0204c19aff 1073741824" returned: 0 in 0.579s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-35a522ab-8735-4d71-bd64-da0204c19aff {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:29 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-35a522ab-8735-4d71-bd64-da0204c19aff Sep 01 12:17:29 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:29 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-35a522ab-8735-4d71-bd64-da0204c19aff" returned: 0 in 0.299s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.340s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1748744391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=349a9c42-40c3-4789-827a-b6d8d81cb3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2afa50e6db504f4a8898560c906048e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:29Z,use_quota=True,user_id='64674987b11f457c9df9dbcd30b271e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d755a1ac-c488-4612-94e5-215622caaa95),volume_type_id=d755a1ac-c488-4612-94e5-215622caaa95)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Creating volume 349a9c42-40c3-4789-827a-b6d8d81cb3b3 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:17:29 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-349a9c42-40c3-4789-827a-b6d8d81cb3b3 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e0bb47-45cf-48c9-9424-629d2c9817ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35a522ab-8735-4d71-bd64-da0204c19aff', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:29 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-349a9c42-40c3-4789-827a-b6d8d81cb3b3 1073741824 Sep 01 12:17:29 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16adc51-c2f1-44c4-ad46-fcae8d0f357d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:29 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Volume volume-35a522ab-8735-4d71-bd64-da0204c19aff (35a522ab-8735-4d71-bd64-da0204c19aff): created successfully Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16adc51-c2f1-44c4-ad46-fcae8d0f357d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:29 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Flow 'volume_create_manager' (57364c52-5d33-4128-9585-c0feb6fc1f0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-06c882c0-d066-4fc6-afe4-edd35c70bc02 tempest-TestInstancesWithCinderVolumes-1035486613 None] Created volume successfully. Sep 01 12:17:30 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-349a9c42-40c3-4789-827a-b6d8d81cb3b3 1073741824" returned: 0 in 0.653s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-349a9c42-40c3-4789-827a-b6d8d81cb3b3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:30 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-349a9c42-40c3-4789-827a-b6d8d81cb3b3 Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:17:30 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Flow 'volume_create_manager' (9f738b8b-18c6-43e2-9aaf-70e38cfe0d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39dda5c3-c2ce-41d3-aa03-f3cc08b02be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39dda5c3-c2ce-41d3-aa03-f3cc08b02be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-375137003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71968bae-fbd6-4c72-b636-5c907e1f8aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2afa50e6db504f4a8898560c906048e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:30Z,use_quota=True,user_id='64674987b11f457c9df9dbcd30b271e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f94b84e7-c914-4b94-8edb-58c005915d7b),volume_type_id=f94b84e7-c914-4b94-8edb-58c005915d7b)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6349b6-2045-45fb-bc45-94f43fef3afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6349b6-2045-45fb-bc45-94f43fef3afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b73c100-2f30-4983-a6c4-5baec7993ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG cinder.image.glance [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Creating Keystone auth plugin from conf {{(pid=87084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 12:17:30 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-349a9c42-40c3-4789-827a-b6d8d81cb3b3" returned: 0 in 0.367s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed57c96-8acd-443b-ab50-74f4d1ed9a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-349a9c42-40c3-4789-827a-b6d8d81cb3b3', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3885f4ba-fae9-4561-88ea-a5815ada0be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:30 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Volume volume-349a9c42-40c3-4789-827a-b6d8d81cb3b3 (349a9c42-40c3-4789-827a-b6d8d81cb3b3): created successfully Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3885f4ba-fae9-4561-88ea-a5815ada0be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Flow 'volume_create_manager' (d9a791a5-bab4-41cf-9c77-aa03b896598d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:30 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-af4baf51-2268-4d83-9cd9-d3a402a81ae1 tempest-TestInstancesWithCinderVolumes-1035486613 None] Created volume successfully. Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b73c100-2f30-4983-a6c4-5baec7993ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '71968bae-fbd6-4c72-b636-5c907e1f8aa5', 'volume_name': 'volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5', 'volume_size': 1, 'image_id': '4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1561650720', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2afa50e6db504f4a8898560c906048e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9', 'created_at': datetime.datetime(2026, 9, 1, 10, 17, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 17, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9/file', 'properties': {}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b99b91-0749-4485-9728-911f15f34b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b99b91-0749-4485-9728-911f15f34b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03097e24-95e3-4ce4-aa92-8eff968c1dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:30 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Volume 71968bae-fbd6-4c72-b636-5c907e1f8aa5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5', 'volume_size': 1, 'image_id': '4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1561650720', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2afa50e6db504f4a8898560c906048e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9', 'created_at': datetime.datetime(2026, 9, 1, 10, 17, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 17, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9/file', 'properties': {}}, 'image_service': } Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Trying to clone 71968bae-fbd6-4c72-b636-5c907e1f8aa5 from image 4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9', 'metadata': {}}]). {{(pid=87084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Flow 'volume_create_manager' (9d4851a4-1b75-4b54-8452-251a1bc1f103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec358548-1736-4d23-8126-7494a1485f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec358548-1736-4d23-8126-7494a1485f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-907414057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c577c54-472a-42c1-a405-50d6c5e2bbee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c458673dbdf4e439df5eeb1bd1fece4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:31Z,use_quota=True,user_id='ceafdf1a7f544b2c839adb3b632454ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bfcea2-5840-4469-994e-e44880239187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bfcea2-5840-4469-994e-e44880239187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a17d7a-c746-442b-8af4-35ecdab3dfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a17d7a-c746-442b-8af4-35ecdab3dfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c577c54-472a-42c1-a405-50d6c5e2bbee', 'volume_name': 'volume-2c577c54-472a-42c1-a405-50d6c5e2bbee', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847b9448-a390-47f9-a4ab-16215a4fb558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847b9448-a390-47f9-a4ab-16215a4fb558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258ca399-5068-4dfd-b914-1d791e70f418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:31 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Volume 2c577c54-472a-42c1-a405-50d6c5e2bbee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c577c54-472a-42c1-a405-50d6c5e2bbee', 'volume_size': 1} Sep 01 12:17:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-907414057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c577c54-472a-42c1-a405-50d6c5e2bbee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c458673dbdf4e439df5eeb1bd1fece4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:31Z,use_quota=True,user_id='ceafdf1a7f544b2c839adb3b632454ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:17:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Creating volume 2c577c54-472a-42c1-a405-50d6c5e2bbee {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:17:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:17:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:17:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:17:31 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:17:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2c577c54-472a-42c1-a405-50d6c5e2bbee 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:31 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2c577c54-472a-42c1-a405-50d6c5e2bbee 1073741824 Sep 01 12:17:31 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:31 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2c577c54-472a-42c1-a405-50d6c5e2bbee 1073741824" returned: 0 in 0.673s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2c577c54-472a-42c1-a405-50d6c5e2bbee {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:31 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2c577c54-472a-42c1-a405-50d6c5e2bbee Sep 01 12:17:31 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:32 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2c577c54-472a-42c1-a405-50d6c5e2bbee" returned: 0 in 0.359s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:17:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258ca399-5068-4dfd-b914-1d791e70f418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c577c54-472a-42c1-a405-50d6c5e2bbee', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8da4ca-c584-4552-b098-37dc6286f281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:32 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Volume volume-2c577c54-472a-42c1-a405-50d6c5e2bbee (2c577c54-472a-42c1-a405-50d6c5e2bbee): created successfully Sep 01 12:17:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8da4ca-c584-4552-b098-37dc6286f281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Flow 'volume_create_manager' (9d4851a4-1b75-4b54-8452-251a1bc1f103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:32 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4ff0db95-b064-4fc2-8d36-dc80e535a613 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Created volume successfully. Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Flow 'volume_create_manager' (1ef7bce7-d447-4f23-a2f3-b37030fa4155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbedf69-2b7e-45ca-8d8f-b372a4ce5528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbedf69-2b7e-45ca-8d8f-b372a4ce5528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1248575265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf5afe4-eb40-4d40-a255-d657e941f05b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c458673dbdf4e439df5eeb1bd1fece4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:34Z,use_quota=True,user_id='ceafdf1a7f544b2c839adb3b632454ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e6ba51-32bd-4bfb-bf3b-a7b5c0004796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e6ba51-32bd-4bfb-bf3b-a7b5c0004796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306ab87d-2339-4787-8dc9-dfb01c584be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306ab87d-2339-4787-8dc9-dfb01c584be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caf5afe4-eb40-4d40-a255-d657e941f05b', 'volume_name': 'volume-caf5afe4-eb40-4d40-a255-d657e941f05b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641ac930-b332-47db-9a4e-60f76d8f3fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641ac930-b332-47db-9a4e-60f76d8f3fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7064d3c1-e446-4ae8-aa3f-42bc8dcedeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:34 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Volume caf5afe4-eb40-4d40-a255-d657e941f05b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caf5afe4-eb40-4d40-a255-d657e941f05b', 'volume_size': 1} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1248575265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf5afe4-eb40-4d40-a255-d657e941f05b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c458673dbdf4e439df5eeb1bd1fece4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:34Z,use_quota=True,user_id='ceafdf1a7f544b2c839adb3b632454ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Creating volume caf5afe4-eb40-4d40-a255-d657e941f05b {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:17:34 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-caf5afe4-eb40-4d40-a255-d657e941f05b 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:34 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-caf5afe4-eb40-4d40-a255-d657e941f05b 1073741824 Sep 01 12:17:34 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Flow 'volume_create_manager' (c2b878da-f8ce-441f-84d8-1090bb232dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4d36cc-5572-4e86-bb50-5a95222b8ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4d36cc-5572-4e86-bb50-5a95222b8ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-805422425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d40bbe3-eb44-4085-b0a8-8eda7b2a812b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09db2764fa444af8a224f6f056a9eb97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:34Z,use_quota=True,user_id='713e9a5eaefa41bdbfee6899edfef147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d9715d-ed52-4a4a-994e-87d20e99ccd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d9715d-ed52-4a4a-994e-87d20e99ccd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd38073-f122-4662-898a-b1a8eff9f639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.image.glance [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Creating Keystone auth plugin from conf {{(pid=87084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Flow 'volume_create_manager' (1162975b-7059-4452-8644-ebe36b7f4898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18f22a7c-a38b-44a4-9c1e-148e1ea5d6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18f22a7c-a38b-44a4-9c1e-148e1ea5d6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-976026404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dcb184e-78a7-4f01-8e02-59c584872685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c458673dbdf4e439df5eeb1bd1fece4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:34Z,use_quota=True,user_id='ceafdf1a7f544b2c839adb3b632454ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e73740-1319-4d1f-9d7c-9f1eea134922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e73740-1319-4d1f-9d7c-9f1eea134922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81cb8d5-0686-4392-9dd3-bde35868977c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81cb8d5-0686-4392-9dd3-bde35868977c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dcb184e-78a7-4f01-8e02-59c584872685', 'volume_name': 'volume-6dcb184e-78a7-4f01-8e02-59c584872685', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d5a010-86c1-4089-aaed-310ab43ab7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d5a010-86c1-4089-aaed-310ab43ab7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e5e168-87b0-4fcc-951e-7d62a5f7988d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:34 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Volume 6dcb184e-78a7-4f01-8e02-59c584872685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dcb184e-78a7-4f01-8e02-59c584872685', 'volume_size': 1} Sep 01 12:17:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Flow 'volume_create_manager' (46a8a3c9-aabc-4c53-913b-d3ce4795def1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06312d20-f2f7-4bb2-b76e-3b23da25b43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:35 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06312d20-f2f7-4bb2-b76e-3b23da25b43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-971239124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b81dc23d-29e1-4bc7-bcc6-12077cad1c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c458673dbdf4e439df5eeb1bd1fece4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:35Z,use_quota=True,user_id='ceafdf1a7f544b2c839adb3b632454ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5939c180-e57a-4611-a70a-8bc9691aeeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5939c180-e57a-4611-a70a-8bc9691aeeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6580f5c8-4e08-4838-86eb-76c7cb2ae336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6580f5c8-4e08-4838-86eb-76c7cb2ae336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b81dc23d-29e1-4bc7-bcc6-12077cad1c7a', 'volume_name': 'volume-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6f323f-15e8-415e-8eef-1f38f1e3d65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6f323f-15e8-415e-8eef-1f38f1e3d65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b87565-74d6-4f39-9098-8946f73483bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:35 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Volume b81dc23d-29e1-4bc7-bcc6-12077cad1c7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a', 'volume_size': 1} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-caf5afe4-eb40-4d40-a255-d657e941f05b 1073741824" returned: 0 in 0.788s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-caf5afe4-eb40-4d40-a255-d657e941f05b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:35 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-caf5afe4-eb40-4d40-a255-d657e941f05b Sep 01 12:17:35 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd38073-f122-4662-898a-b1a8eff9f639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6d40bbe3-eb44-4085-b0a8-8eda7b2a812b', 'volume_name': 'volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b', 'volume_size': 1, 'image_id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42fce3cc35724a058187a1135a373ea9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'created_at': datetime.datetime(2026, 9, 1, 9, 59, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 59, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b4a619c-a673-44af-9f40-771e3ca841e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b4a619c-a673-44af-9f40-771e3ca841e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd21036-d7d0-4902-9269-713adbac2e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:35 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Volume 6d40bbe3-eb44-4085-b0a8-8eda7b2a812b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b', 'volume_size': 1, 'image_id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42fce3cc35724a058187a1135a373ea9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'created_at': datetime.datetime(2026, 9, 1, 9, 59, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 59, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Trying to clone 6d40bbe3-eb44-4085-b0a8-8eda7b2a812b from image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}]). {{(pid=87084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 12:17:35 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Flow 'volume_create_manager' (0411eedf-e56b-49ae-97e2-2c71268be6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c3fe55-3c0a-4485-b7eb-3c6498fa7fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-caf5afe4-eb40-4d40-a255-d657e941f05b" returned: 0 in 0.448s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.054s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-976026404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dcb184e-78a7-4f01-8e02-59c584872685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c458673dbdf4e439df5eeb1bd1fece4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:34Z,use_quota=True,user_id='ceafdf1a7f544b2c839adb3b632454ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Creating volume 6dcb184e-78a7-4f01-8e02-59c584872685 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:17:35 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6dcb184e-78a7-4f01-8e02-59c584872685 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c3fe55-3c0a-4485-b7eb-3c6498fa7fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-276090569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5544e5c5-4a48-4abd-baca-ec4ebaad3478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c458673dbdf4e439df5eeb1bd1fece4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:35Z,use_quota=True,user_id='ceafdf1a7f544b2c839adb3b632454ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:35 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6dcb184e-78a7-4f01-8e02-59c584872685 1073741824 Sep 01 12:17:35 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f111dc35-20fb-464c-a468-406c5de920f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f111dc35-20fb-464c-a468-406c5de920f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74169bd6-bfe1-4e22-9593-8e64ac740706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74169bd6-bfe1-4e22-9593-8e64ac740706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5544e5c5-4a48-4abd-baca-ec4ebaad3478', 'volume_name': 'volume-5544e5c5-4a48-4abd-baca-ec4ebaad3478', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10851cc-9196-439e-8437-07f415697b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10851cc-9196-439e-8437-07f415697b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b14582a-f945-41d5-bfb2-8e55e1dfe195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:35 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Volume 5544e5c5-4a48-4abd-baca-ec4ebaad3478: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5544e5c5-4a48-4abd-baca-ec4ebaad3478', 'volume_size': 1} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7064d3c1-e446-4ae8-aa3f-42bc8dcedeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caf5afe4-eb40-4d40-a255-d657e941f05b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a6a89e9-62bb-46e3-aa50-00c2a016b588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:35 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Volume volume-caf5afe4-eb40-4d40-a255-d657e941f05b (caf5afe4-eb40-4d40-a255-d657e941f05b): created successfully Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a6a89e9-62bb-46e3-aa50-00c2a016b588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Flow 'volume_create_manager' (1ef7bce7-d447-4f23-a2f3-b37030fa4155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:35 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-07c6f834-47c5-49c9-943d-a2766370b6d9 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Created volume successfully. Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lzwcgcypdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 12:17:35 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Image download 20.69 MB at 20.69 MB/s Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c07bf2f-0d64-4dd1-a6e9-e464f66a007e]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:17:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lzwcgcypdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9_3cba_0ucdevstack@QuobyteHD, size 20.69 MB, duration 5.08 sec {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 12:17:36 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Image download 20.69 MB at 4.08 MB/s Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edd272f-6007-4711-bc13-1a66488ae1e4]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9_3cba_0ucdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:36 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lzwcgcypdevstack@QuobyteHD Sep 01 12:17:36 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:36 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9_3cba_0ucdevstack@QuobyteHD Sep 01 12:17:36 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Flow 'volume_create_manager' (07c904dc-3099-4a36-b03d-1454675a3350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (080611e7-a160-47d2-b603-b8acc7f53254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (080611e7-a160-47d2-b603-b8acc7f53254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-974806446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60073a5-ea70-4652-9983-85749a9ea8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c458673dbdf4e439df5eeb1bd1fece4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:36Z,use_quota=True,user_id='ceafdf1a7f544b2c839adb3b632454ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa40cc3-7ee0-4ee8-b4d6-5801829f46f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa40cc3-7ee0-4ee8-b4d6-5801829f46f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6611c2-682d-4bd1-9226-051256b9930b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6611c2-682d-4bd1-9226-051256b9930b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a60073a5-ea70-4652-9983-85749a9ea8a1', 'volume_name': 'volume-a60073a5-ea70-4652-9983-85749a9ea8a1', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d09a1c-4cdf-47d4-b7fe-2d66e1d0ac96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d09a1c-4cdf-47d4-b7fe-2d66e1d0ac96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce7c349-9dbb-4f40-921c-1039286c45e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:36 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Volume a60073a5-ea70-4652-9983-85749a9ea8a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a60073a5-ea70-4652-9983-85749a9ea8a1', 'volume_size': 1} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:36 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6dcb184e-78a7-4f01-8e02-59c584872685 1073741824" returned: 0 in 0.710s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6dcb184e-78a7-4f01-8e02-59c584872685 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:36 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6dcb184e-78a7-4f01-8e02-59c584872685 Sep 01 12:17:36 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:36 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lzwcgcypdevstack@QuobyteHD" returned: 0 in 0.522s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Temporary image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c is fetched for user 713e9a5eaefa41bdbfee6899edfef147. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 12:17:36 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9_3cba_0ucdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Temporary image 4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9 is fetched for user 64674987b11f457c9df9dbcd30b271e9. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e825d98f-ad7e-4935-a7bf-f2596007bff7]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lzwcgcypdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d55e7ce-1b9e-47b4-b380-44a0c1352e97]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9_3cba_0ucdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:36 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lzwcgcypdevstack@QuobyteHD Sep 01 12:17:36 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6dcb184e-78a7-4f01-8e02-59c584872685" returned: 0 in 0.339s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:17:36 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.635s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-971239124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b81dc23d-29e1-4bc7-bcc6-12077cad1c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c458673dbdf4e439df5eeb1bd1fece4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:35Z,use_quota=True,user_id='ceafdf1a7f544b2c839adb3b632454ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Creating volume b81dc23d-29e1-4bc7-bcc6-12077cad1c7a {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:36 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9_3cba_0ucdevstack@QuobyteHD Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:17:36 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:17:36 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:36 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a 1073741824 Sep 01 12:17:36 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e5e168-87b0-4fcc-951e-7d62a5f7988d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dcb184e-78a7-4f01-8e02-59c584872685', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d508c6-0b6f-423f-bbaa-812965fc0fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:36 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Volume volume-6dcb184e-78a7-4f01-8e02-59c584872685 (6dcb184e-78a7-4f01-8e02-59c584872685): created successfully Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d508c6-0b6f-423f-bbaa-812965fc0fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Flow 'volume_create_manager' (1162975b-7059-4452-8644-ebe36b7f4898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:36 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4af2182a-c47a-4663-8704-79decbd39e10 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Created volume successfully. Sep 01 12:17:36 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lzwcgcypdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:37 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9_3cba_0ucdevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:37 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a 1073741824" returned: 0 in 0.471s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:37 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a Sep 01 12:17:37 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:37 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a" returned: 0 in 0.259s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.798s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-276090569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5544e5c5-4a48-4abd-baca-ec4ebaad3478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c458673dbdf4e439df5eeb1bd1fece4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:35Z,use_quota=True,user_id='ceafdf1a7f544b2c839adb3b632454ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Creating volume 5544e5c5-4a48-4abd-baca-ec4ebaad3478 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:17:37 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5544e5c5-4a48-4abd-baca-ec4ebaad3478 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:37 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5544e5c5-4a48-4abd-baca-ec4ebaad3478 1073741824 Sep 01 12:17:37 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b87565-74d6-4f39-9098-8946f73483bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72cc8234-a4be-4231-a437-f397603b8eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:37 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Volume volume-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a (b81dc23d-29e1-4bc7-bcc6-12077cad1c7a): created successfully Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72cc8234-a4be-4231-a437-f397603b8eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Flow 'volume_create_manager' (46a8a3c9-aabc-4c53-913b-d3ce4795def1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b12f363c-7097-41fb-88d4-473b7ac0ca49 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Created volume successfully. Sep 01 12:17:37 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5544e5c5-4a48-4abd-baca-ec4ebaad3478 1073741824" returned: 0 in 0.436s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5544e5c5-4a48-4abd-baca-ec4ebaad3478 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:38 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5544e5c5-4a48-4abd-baca-ec4ebaad3478 Sep 01 12:17:38 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:38 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5544e5c5-4a48-4abd-baca-ec4ebaad3478" returned: 0 in 0.258s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.941s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-974806446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60073a5-ea70-4652-9983-85749a9ea8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c458673dbdf4e439df5eeb1bd1fece4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:36Z,use_quota=True,user_id='ceafdf1a7f544b2c839adb3b632454ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Creating volume a60073a5-ea70-4652-9983-85749a9ea8a1 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:17:38 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a60073a5-ea70-4652-9983-85749a9ea8a1 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:38 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a60073a5-ea70-4652-9983-85749a9ea8a1 1073741824 Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b14582a-f945-41d5-bfb2-8e55e1dfe195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5544e5c5-4a48-4abd-baca-ec4ebaad3478', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:38 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edce8ed2-849e-4c72-a5c1-721cf3a3782a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:38 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Volume volume-5544e5c5-4a48-4abd-baca-ec4ebaad3478 (5544e5c5-4a48-4abd-baca-ec4ebaad3478): created successfully Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edce8ed2-849e-4c72-a5c1-721cf3a3782a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Flow 'volume_create_manager' (0411eedf-e56b-49ae-97e2-2c71268be6ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:38 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b8699b80-9618-4d96-b019-696a99de9378 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Created volume successfully. Sep 01 12:17:38 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a60073a5-ea70-4652-9983-85749a9ea8a1 1073741824" returned: 0 in 0.443s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a60073a5-ea70-4652-9983-85749a9ea8a1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:17:38 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a60073a5-ea70-4652-9983-85749a9ea8a1 Sep 01 12:17:38 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Flow 'volume_create_manager' (d852822d-7e96-41af-82e6-a97081a5ebd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe55292-50aa-4524-891b-5d6ca2329b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe55292-50aa-4524-891b-5d6ca2329b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2041532086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d8a586f-6286-4508-ac59-fcc204a1732e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a8176924dd4233884ea26cba316f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:39Z,use_quota=True,user_id='83f03bf0e7304502977a9d8c3455aad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1cb0cc9-4b38-4cce-a8c0-ea48e2e5bf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1cb0cc9-4b38-4cce-a8c0-ea48e2e5bf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (269c4e12-db3c-4d68-9f83-12c395cbbeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (269c4e12-db3c-4d68-9f83-12c395cbbeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d8a586f-6286-4508-ac59-fcc204a1732e', 'volume_name': 'volume-8d8a586f-6286-4508-ac59-fcc204a1732e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172f0204-5257-4a0e-89a4-cf41fc6f83c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172f0204-5257-4a0e-89a4-cf41fc6f83c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b422776d-9565-48d5-b977-721cc00b2ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:38 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Volume 8d8a586f-6286-4508-ac59-fcc204a1732e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d8a586f-6286-4508-ac59-fcc204a1732e', 'volume_size': 1} Sep 01 12:17:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:39 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a60073a5-ea70-4652-9983-85749a9ea8a1" returned: 0 in 0.235s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.045s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-805422425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d40bbe3-eb44-4085-b0a8-8eda7b2a812b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09db2764fa444af8a224f6f056a9eb97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:34Z,use_quota=True,user_id='713e9a5eaefa41bdbfee6899edfef147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Creating volume 6d40bbe3-eb44-4085-b0a8-8eda7b2a812b {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:17:39 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce7c349-9dbb-4f40-921c-1039286c45e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a60073a5-ea70-4652-9983-85749a9ea8a1', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:39 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b 1073741824 Sep 01 12:17:39 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b49f10-b263-4aae-9baa-969c924a9d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Volume volume-a60073a5-ea70-4652-9983-85749a9ea8a1 (a60073a5-ea70-4652-9983-85749a9ea8a1): created successfully Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b49f10-b263-4aae-9baa-969c924a9d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Flow 'volume_create_manager' (07c904dc-3099-4a36-b03d-1454675a3350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:39 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4cec3426-aed1-4256-8578-80dc94bc6243 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Created volume successfully. Sep 01 12:17:39 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b 1073741824" returned: 0 in 0.394s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:39 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b Sep 01 12:17:39 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a50efb68-c590-49db-bc65-9cc019811a41 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "cinder-a60073a5-ea70-4652-9983-85749a9ea8a1-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a50efb68-c590-49db-bc65-9cc019811a41 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-a60073a5-ea70-4652-9983-85749a9ea8a1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a50efb68-c590-49db-bc65-9cc019811a41 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "cinder-quobyte-a60073a5-ea70-4652-9983-85749a9ea8a1" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a50efb68-c590-49db-bc65-9cc019811a41 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-quobyte-a60073a5-ea70-4652-9983-85749a9ea8a1" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a352c68c-dfb5-4c9b-8692-81ec08d979a5]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a50efb68-c590-49db-bc65-9cc019811a41 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a60073a5-ea70-4652-9983-85749a9ea8a1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:39 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b" returned: 0 in 0.265s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.651s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-375137003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71968bae-fbd6-4c72-b636-5c907e1f8aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2afa50e6db504f4a8898560c906048e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:30Z,use_quota=True,user_id='64674987b11f457c9df9dbcd30b271e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f94b84e7-c914-4b94-8edb-58c005915d7b),volume_type_id=f94b84e7-c914-4b94-8edb-58c005915d7b)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Creating volume 71968bae-fbd6-4c72-b636-5c907e1f8aa5 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:17:39 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:39 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a60073a5-ea70-4652-9983-85749a9ea8a1 Sep 01 12:17:39 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5 1073741824 Sep 01 12:17:39 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:39 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Attempting download of 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c ((None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}])) to volume 6d40bbe3-eb44-4085-b0a8-8eda7b2a812b. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[74009a6d-40f6-409c-aae2-977a49fb975b]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:17:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_78wdwdhn {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:39 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_78wdwdhn Sep 01 12:17:39 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:40 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a50efb68-c590-49db-bc65-9cc019811a41 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a60073a5-ea70-4652-9983-85749a9ea8a1" returned: 0 in 0.392s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a50efb68-c590-49db-bc65-9cc019811a41 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a60073a5-ea70-4652-9983-85749a9ea8a1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:40 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a60073a5-ea70-4652-9983-85749a9ea8a1 Sep 01 12:17:40 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:40 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_78wdwdhn" returned: 0 in 0.340s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_78wdwdhn {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:40 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5 1073741824" returned: 0 in 0.479s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:40 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5 Sep 01 12:17:40 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:40 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_78wdwdhn Sep 01 12:17:40 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:40 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a50efb68-c590-49db-bc65-9cc019811a41 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a60073a5-ea70-4652-9983-85749a9ea8a1" returned: 0 in 0.279s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a50efb68-c590-49db-bc65-9cc019811a41 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-quobyte-a60073a5-ea70-4652-9983-85749a9ea8a1" released by "delete_volume" :: held 0.718s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a50efb68-c590-49db-bc65-9cc019811a41 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Created reservations ['2c3191c6-669b-4837-86a7-bfc6ebbdd286', '0d449116-4c76-4d30-98e1-31d3f7c6557d', '02618f1a-42aa-481c-89b8-6592f3d14c3c', '52e34ce3-9a6c-4ec7-a36b-26d1aa50556b'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a50efb68-c590-49db-bc65-9cc019811a41 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a50efb68-c590-49db-bc65-9cc019811a41 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a50efb68-c590-49db-bc65-9cc019811a41 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a50efb68-c590-49db-bc65-9cc019811a41 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a50efb68-c590-49db-bc65-9cc019811a41 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a50efb68-c590-49db-bc65-9cc019811a41 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:40 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:17:40 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:40 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5" returned: 0 in 0.270s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.653s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2041532086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d8a586f-6286-4508-ac59-fcc204a1732e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a8176924dd4233884ea26cba316f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:39Z,use_quota=True,user_id='83f03bf0e7304502977a9d8c3455aad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Creating volume 8d8a586f-6286-4508-ac59-fcc204a1732e {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:17:40 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8d8a586f-6286-4508-ac59-fcc204a1732e 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:40 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_78wdwdhn" returned: 1 in 0.382s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_78wdwdhn' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[595d5bf5-3413-4a52-ba80-f911c34760ae]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lzwcgcypdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:40 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8d8a586f-6286-4508-ac59-fcc204a1732e 1073741824 Sep 01 12:17:40 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Attempting download of 4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9', 'metadata': {}}])) to volume 71968bae-fbd6-4c72-b636-5c907e1f8aa5. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b66910b-a01d-4b12-9a38-2e27abb08eac]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9_dzghxunb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:40 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lzwcgcypdevstack@QuobyteHD Sep 01 12:17:40 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:40 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a50efb68-c590-49db-bc65-9cc019811a41 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.306s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-a50efb68-c590-49db-bc65-9cc019811a41 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9ba668bc-3ddf-4bdd-8f15-8dda48b250ef tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "cinder-5544e5c5-4a48-4abd-baca-ec4ebaad3478-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:17:40 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a50efb68-c590-49db-bc65-9cc019811a41 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Deleted volume successfully. Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9ba668bc-3ddf-4bdd-8f15-8dda48b250ef tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-5544e5c5-4a48-4abd-baca-ec4ebaad3478-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a50efb68-c590-49db-bc65-9cc019811a41 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-a60073a5-ea70-4652-9983-85749a9ea8a1-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9ba668bc-3ddf-4bdd-8f15-8dda48b250ef tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "cinder-quobyte-5544e5c5-4a48-4abd-baca-ec4ebaad3478" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9ba668bc-3ddf-4bdd-8f15-8dda48b250ef tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-quobyte-5544e5c5-4a48-4abd-baca-ec4ebaad3478" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[decb48ec-7c2c-4784-8965-38e4f149f46c]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9ba668bc-3ddf-4bdd-8f15-8dda48b250ef tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5544e5c5-4a48-4abd-baca-ec4ebaad3478 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:40 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9_dzghxunb Sep 01 12:17:40 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:40 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lzwcgcypdevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c was qcow2, converting to qcow2 {{(pid=87084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 12:17:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lzwcgcypdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:41 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5544e5c5-4a48-4abd-baca-ec4ebaad3478 Sep 01 12:17:41 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:41 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lzwcgcypdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b Sep 01 12:17:41 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:41 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8d8a586f-6286-4508-ac59-fcc204a1732e 1073741824" returned: 0 in 0.559s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8d8a586f-6286-4508-ac59-fcc204a1732e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:41 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:41 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8d8a586f-6286-4508-ac59-fcc204a1732e Sep 01 12:17:41 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9_dzghxunb" returned: 0 in 0.491s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9_dzghxunb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:41 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9ba668bc-3ddf-4bdd-8f15-8dda48b250ef tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5544e5c5-4a48-4abd-baca-ec4ebaad3478" returned: 0 in 0.429s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9ba668bc-3ddf-4bdd-8f15-8dda48b250ef tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5544e5c5-4a48-4abd-baca-ec4ebaad3478 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:41 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9_dzghxunb Sep 01 12:17:41 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:41 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5544e5c5-4a48-4abd-baca-ec4ebaad3478 Sep 01 12:17:41 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:41 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8d8a586f-6286-4508-ac59-fcc204a1732e" returned: 0 in 0.292s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b422776d-9565-48d5-b977-721cc00b2ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d8a586f-6286-4508-ac59-fcc204a1732e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e211009-4674-4fe2-8b06-807a5b9ce006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Volume volume-8d8a586f-6286-4508-ac59-fcc204a1732e (8d8a586f-6286-4508-ac59-fcc204a1732e): created successfully Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e211009-4674-4fe2-8b06-807a5b9ce006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Flow 'volume_create_manager' (d852822d-7e96-41af-82e6-a97081a5ebd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3dd58a8b-5c0d-4406-880b-7d42cce3f271 tempest-VolumeQuotasAdminTestJSON-506138322 None] Created volume successfully. Sep 01 12:17:41 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9_dzghxunb" returned: 1 in 0.438s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9_dzghxunb' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[68af8b79-3a67-4f7d-83c2-60d74ffb39aa]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9_3cba_0ucdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:41 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9ba668bc-3ddf-4bdd-8f15-8dda48b250ef tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5544e5c5-4a48-4abd-baca-ec4ebaad3478" returned: 0 in 0.300s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9ba668bc-3ddf-4bdd-8f15-8dda48b250ef tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-quobyte-5544e5c5-4a48-4abd-baca-ec4ebaad3478" released by "delete_volume" :: held 0.784s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-9ba668bc-3ddf-4bdd-8f15-8dda48b250ef tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Created reservations ['97fb1d40-92dc-43ec-888b-f920215ea1e6', 'eb8cd593-b36e-4721-9548-702d09261f1c', '4afdffd0-66b1-46ee-9006-262e036b947d', 'c4a40f2b-b0ec-464c-b1fa-e5095b64efbe'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:17:41 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9_3cba_0ucdevstack@QuobyteHD Sep 01 12:17:41 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9ba668bc-3ddf-4bdd-8f15-8dda48b250ef tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9ba668bc-3ddf-4bdd-8f15-8dda48b250ef tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9ba668bc-3ddf-4bdd-8f15-8dda48b250ef tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9ba668bc-3ddf-4bdd-8f15-8dda48b250ef tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9ba668bc-3ddf-4bdd-8f15-8dda48b250ef tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9ba668bc-3ddf-4bdd-8f15-8dda48b250ef tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:41 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:17:41 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:41 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:17:41 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ab73175c-dcbd-4f7f-ad72-4bb16cf149af tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "cinder-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-684bfd17-b18b-4782-b830-c04e4f7a9bc1 tempest-VolumeQuotasAdminTestJSON-506138322 None] Acquiring lock "cinder-8d8a586f-6286-4508-ac59-fcc204a1732e-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:17:42 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.334s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-684bfd17-b18b-4782-b830-c04e4f7a9bc1 tempest-VolumeQuotasAdminTestJSON-506138322 None] Lock "cinder-8d8a586f-6286-4508-ac59-fcc204a1732e-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:17:42 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ab73175c-dcbd-4f7f-ad72-4bb16cf149af tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9_3cba_0ucdevstack@QuobyteHD" returned: 0 in 0.594s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] 4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9 was qcow2, converting to qcow2 {{(pid=87084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9_3cba_0ucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:42 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9ba668bc-3ddf-4bdd-8f15-8dda48b250ef tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.455s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-9ba668bc-3ddf-4bdd-8f15-8dda48b250ef tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:17:42 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9ba668bc-3ddf-4bdd-8f15-8dda48b250ef tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Deleted volume successfully. Sep 01 12:17:42 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9_3cba_0ucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5 Sep 01 12:17:42 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-684bfd17-b18b-4782-b830-c04e4f7a9bc1 tempest-VolumeQuotasAdminTestJSON-506138322 None] Acquiring lock "cinder-quobyte-8d8a586f-6286-4508-ac59-fcc204a1732e" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ab73175c-dcbd-4f7f-ad72-4bb16cf149af tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "cinder-quobyte-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9ba668bc-3ddf-4bdd-8f15-8dda48b250ef tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-5544e5c5-4a48-4abd-baca-ec4ebaad3478-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ab73175c-dcbd-4f7f-ad72-4bb16cf149af tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-quobyte-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-684bfd17-b18b-4782-b830-c04e4f7a9bc1 tempest-VolumeQuotasAdminTestJSON-506138322 None] Lock "cinder-quobyte-8d8a586f-6286-4508-ac59-fcc204a1732e" acquired by "delete_volume" :: waited 0.057s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d1d0a5-b2e8-4632-805f-35901bbe9033]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ab73175c-dcbd-4f7f-ad72-4bb16cf149af tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac211f7-7272-40b5-a004-4c594a4d3a95]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-684bfd17-b18b-4782-b830-c04e4f7a9bc1 tempest-VolumeQuotasAdminTestJSON-506138322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8d8a586f-6286-4508-ac59-fcc204a1732e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:42 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8d8a586f-6286-4508-ac59-fcc204a1732e Sep 01 12:17:42 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:42 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a Sep 01 12:17:42 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:42 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ab73175c-dcbd-4f7f-ad72-4bb16cf149af tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a" returned: 0 in 0.458s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ab73175c-dcbd-4f7f-ad72-4bb16cf149af tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:42 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a Sep 01 12:17:42 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:42 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-684bfd17-b18b-4782-b830-c04e4f7a9bc1 tempest-VolumeQuotasAdminTestJSON-506138322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8d8a586f-6286-4508-ac59-fcc204a1732e" returned: 0 in 0.500s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-684bfd17-b18b-4782-b830-c04e4f7a9bc1 tempest-VolumeQuotasAdminTestJSON-506138322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8d8a586f-6286-4508-ac59-fcc204a1732e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:42 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8d8a586f-6286-4508-ac59-fcc204a1732e Sep 01 12:17:42 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:43 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lzwcgcypdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b" returned: 0 in 2.086s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_lzwcgcypdevstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:17:43 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Converted 112.00 MB image at 53.64 MB/s Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:43 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:43 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b 1G Sep 01 12:17:43 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ab73175c-dcbd-4f7f-ad72-4bb16cf149af tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a" returned: 0 in 0.277s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ab73175c-dcbd-4f7f-ad72-4bb16cf149af tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-quobyte-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a" released by "delete_volume" :: held 0.811s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-ab73175c-dcbd-4f7f-ad72-4bb16cf149af tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Created reservations ['002a2e1e-ceba-4bfc-9266-bd551a29e7d5', 'f2106736-01b7-4fa4-b360-ba75424389a5', '5be1f540-1843-4b3d-b9e7-380f7de2ac32', 'b7d75de3-6b24-4263-bcc8-4f0ccc6997c4'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:17:43 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-684bfd17-b18b-4782-b830-c04e4f7a9bc1 tempest-VolumeQuotasAdminTestJSON-506138322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8d8a586f-6286-4508-ac59-fcc204a1732e" returned: 0 in 0.367s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-684bfd17-b18b-4782-b830-c04e4f7a9bc1 tempest-VolumeQuotasAdminTestJSON-506138322 None] Lock "cinder-quobyte-8d8a586f-6286-4508-ac59-fcc204a1732e" released by "delete_volume" :: held 0.917s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ab73175c-dcbd-4f7f-ad72-4bb16cf149af tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ab73175c-dcbd-4f7f-ad72-4bb16cf149af tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ab73175c-dcbd-4f7f-ad72-4bb16cf149af tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ab73175c-dcbd-4f7f-ad72-4bb16cf149af tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ab73175c-dcbd-4f7f-ad72-4bb16cf149af tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ab73175c-dcbd-4f7f-ad72-4bb16cf149af tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-684bfd17-b18b-4782-b830-c04e4f7a9bc1 tempest-VolumeQuotasAdminTestJSON-506138322 None] Created reservations ['5f6edd1b-1da8-4711-ada2-b6668da953ce', '9ffb52ef-c5fc-4bba-b496-f1d346803007', '99dcf702-9aba-4057-a5bb-fc8349ee6182', '5ac9f3d6-eb53-4715-8032-9794607894e5'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:17:43 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:17:43 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-684bfd17-b18b-4782-b830-c04e4f7a9bc1 tempest-VolumeQuotasAdminTestJSON-506138322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-684bfd17-b18b-4782-b830-c04e4f7a9bc1 tempest-VolumeQuotasAdminTestJSON-506138322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-684bfd17-b18b-4782-b830-c04e4f7a9bc1 tempest-VolumeQuotasAdminTestJSON-506138322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-684bfd17-b18b-4782-b830-c04e4f7a9bc1 tempest-VolumeQuotasAdminTestJSON-506138322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-684bfd17-b18b-4782-b830-c04e4f7a9bc1 tempest-VolumeQuotasAdminTestJSON-506138322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-684bfd17-b18b-4782-b830-c04e4f7a9bc1 tempest-VolumeQuotasAdminTestJSON-506138322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:43 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:17:43 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:43 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b 1G" returned: 0 in 0.467s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Downloaded image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c ((None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}])) to volume 6d40bbe3-eb44-4085-b0a8-8eda7b2a812b successfully. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Temporary image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c for user 713e9a5eaefa41bdbfee6899edfef147 is deleted. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Marking volume 6d40bbe3-eb44-4085-b0a8-8eda7b2a812b as bootable. {{(pid=87084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Copying metadata from image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c to 6d40bbe3-eb44-4085-b0a8-8eda7b2a812b. {{(pid=87084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Creating volume glance metadata for volume 6d40bbe3-eb44-4085-b0a8-8eda7b2a812b backed by image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 12:17:43 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ab73175c-dcbd-4f7f-ad72-4bb16cf149af tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.306s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-ab73175c-dcbd-4f7f-ad72-4bb16cf149af tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:17:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ab73175c-dcbd-4f7f-ad72-4bb16cf149af tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Deleted volume successfully. Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd21036-d7d0-4902-9269-713adbac2e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b', 'volume_size': 1, 'image_id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42fce3cc35724a058187a1135a373ea9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'created_at': datetime.datetime(2026, 9, 1, 9, 59, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 59, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c475ba-4ff3-4817-a9dc-21dbda93dae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ab73175c-dcbd-4f7f-ad72-4bb16cf149af tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-b81dc23d-29e1-4bc7-bcc6-12077cad1c7a-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:17:43 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Volume volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b (6d40bbe3-eb44-4085-b0a8-8eda7b2a812b): created successfully Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c475ba-4ff3-4817-a9dc-21dbda93dae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Flow 'volume_create_manager' (c2b878da-f8ce-441f-84d8-1090bb232dfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d827a234-6684-438f-8de4-52c1ab6b9616 tempest-TestShelveInstance-1786574594 None] Created volume successfully. Sep 01 12:17:43 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-684bfd17-b18b-4782-b830-c04e4f7a9bc1 tempest-VolumeQuotasAdminTestJSON-506138322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.311s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-684bfd17-b18b-4782-b830-c04e4f7a9bc1 tempest-VolumeQuotasAdminTestJSON-506138322 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:17:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-684bfd17-b18b-4782-b830-c04e4f7a9bc1 tempest-VolumeQuotasAdminTestJSON-506138322 None] Deleted volume successfully. Sep 01 12:17:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-684bfd17-b18b-4782-b830-c04e4f7a9bc1 tempest-VolumeQuotasAdminTestJSON-506138322 None] Lock "cinder-8d8a586f-6286-4508-ac59-fcc204a1732e-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:17:44 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9_3cba_0ucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5" returned: 0 in 1.953s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:44 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9_3cba_0ucdevstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:17:44 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Converted 112.00 MB image at 57.33 MB/s Sep 01 12:17:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:44 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5 1G Sep 01 12:17:44 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-08e1cad2-bdf5-4cf2-be0b-0ec77c413cd7 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "cinder-6dcb184e-78a7-4f01-8e02-59c584872685-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:17:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-08e1cad2-bdf5-4cf2-be0b-0ec77c413cd7 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-6dcb184e-78a7-4f01-8e02-59c584872685-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:17:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-08e1cad2-bdf5-4cf2-be0b-0ec77c413cd7 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "cinder-quobyte-6dcb184e-78a7-4f01-8e02-59c584872685" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:17:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-08e1cad2-bdf5-4cf2-be0b-0ec77c413cd7 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-quobyte-6dcb184e-78a7-4f01-8e02-59c584872685" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:17:44 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f800b42-de72-4051-83b0-0e4b5850ae55]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:17:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-08e1cad2-bdf5-4cf2-be0b-0ec77c413cd7 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6dcb184e-78a7-4f01-8e02-59c584872685 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:44 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5 1G" returned: 0 in 0.403s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:44 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Downloaded image 4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9', 'metadata': {}}])) to volume 71968bae-fbd6-4c72-b636-5c907e1f8aa5 successfully. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 12:17:44 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Temporary image 4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9 for user 64674987b11f457c9df9dbcd30b271e9 is deleted. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 12:17:44 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Marking volume 71968bae-fbd6-4c72-b636-5c907e1f8aa5 as bootable. {{(pid=87084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 12:17:44 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6dcb184e-78a7-4f01-8e02-59c584872685 Sep 01 12:17:44 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:44 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Copying metadata from image 4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9 to 71968bae-fbd6-4c72-b636-5c907e1f8aa5. {{(pid=87084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 12:17:44 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Creating volume glance metadata for volume 71968bae-fbd6-4c72-b636-5c907e1f8aa5 backed by image 4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9 with: {'image_id': '4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9', 'image_name': 'tempest-scenario-img--1561650720', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 12:17:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03097e24-95e3-4ce4-aa92-8eff968c1dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5', 'volume_size': 1, 'image_id': '4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1561650720', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2afa50e6db504f4a8898560c906048e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9', 'created_at': datetime.datetime(2026, 9, 1, 10, 17, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 17, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4885d5a5-f8b5-4bd8-8a48-27a080b2a1f9/file', 'properties': {}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f38ccb9-2670-4579-8de7-83dfa988c220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:44 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Volume volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5 (71968bae-fbd6-4c72-b636-5c907e1f8aa5): created successfully Sep 01 12:17:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f38ccb9-2670-4579-8de7-83dfa988c220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Flow 'volume_create_manager' (9f738b8b-18c6-43e2-9aaf-70e38cfe0d22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:44 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7bf61667-a34b-41ca-8ac2-f26b894d69be tempest-TestInstancesWithCinderVolumes-1035486613 None] Created volume successfully. Sep 01 12:17:45 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-08e1cad2-bdf5-4cf2-be0b-0ec77c413cd7 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6dcb184e-78a7-4f01-8e02-59c584872685" returned: 0 in 0.462s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-08e1cad2-bdf5-4cf2-be0b-0ec77c413cd7 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6dcb184e-78a7-4f01-8e02-59c584872685 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:45 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6dcb184e-78a7-4f01-8e02-59c584872685 Sep 01 12:17:45 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Flow 'volume_create_manager' (080ddc23-b951-4312-ae9e-f975654a7824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab11dc93-52e1-43f0-a8e8-8788be5ab1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab11dc93-52e1-43f0-a8e8-8788be5ab1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-945011992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9889deb8-c5b4-449a-84ce-5b37035cf92c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a8176924dd4233884ea26cba316f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:45Z,use_quota=True,user_id='83f03bf0e7304502977a9d8c3455aad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c3d0a5-4bc6-4988-b7ae-2895d166b093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c3d0a5-4bc6-4988-b7ae-2895d166b093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48eeb779-b806-4106-8859-f1fa8fac5c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48eeb779-b806-4106-8859-f1fa8fac5c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9889deb8-c5b4-449a-84ce-5b37035cf92c', 'volume_name': 'volume-9889deb8-c5b4-449a-84ce-5b37035cf92c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a215e2f-c952-489f-b4e5-99e642dee602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a215e2f-c952-489f-b4e5-99e642dee602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a1fcb2-dc12-4ff4-b1dd-668619cb1ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:45 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Volume 9889deb8-c5b4-449a-84ce-5b37035cf92c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9889deb8-c5b4-449a-84ce-5b37035cf92c', 'volume_size': 1} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-945011992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9889deb8-c5b4-449a-84ce-5b37035cf92c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a8176924dd4233884ea26cba316f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:17:45Z,use_quota=True,user_id='83f03bf0e7304502977a9d8c3455aad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Creating volume 9889deb8-c5b4-449a-84ce-5b37035cf92c {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:17:45 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9889deb8-c5b4-449a-84ce-5b37035cf92c 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:45 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-08e1cad2-bdf5-4cf2-be0b-0ec77c413cd7 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6dcb184e-78a7-4f01-8e02-59c584872685" returned: 0 in 0.319s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:45 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9889deb8-c5b4-449a-84ce-5b37035cf92c 1073741824 Sep 01 12:17:45 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-08e1cad2-bdf5-4cf2-be0b-0ec77c413cd7 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-quobyte-6dcb184e-78a7-4f01-8e02-59c584872685" released by "delete_volume" :: held 0.835s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-08e1cad2-bdf5-4cf2-be0b-0ec77c413cd7 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Created reservations ['d9f58d16-d3a7-4bf2-a18f-968be97d991a', '7bfa0882-b8ba-48c8-a43b-65a97647823b', '02952e10-cb75-459e-8ba8-c39cb20e22e8', '8e2feb55-e994-4dbc-9326-e06b196744ae'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-08e1cad2-bdf5-4cf2-be0b-0ec77c413cd7 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-08e1cad2-bdf5-4cf2-be0b-0ec77c413cd7 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-08e1cad2-bdf5-4cf2-be0b-0ec77c413cd7 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-08e1cad2-bdf5-4cf2-be0b-0ec77c413cd7 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-08e1cad2-bdf5-4cf2-be0b-0ec77c413cd7 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-08e1cad2-bdf5-4cf2-be0b-0ec77c413cd7 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:45 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:17:45 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-75878f87-e01c-4586-ac0e-d45184ff7194 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "cinder-caf5afe4-eb40-4d40-a255-d657e941f05b-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-75878f87-e01c-4586-ac0e-d45184ff7194 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-caf5afe4-eb40-4d40-a255-d657e941f05b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-75878f87-e01c-4586-ac0e-d45184ff7194 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "cinder-quobyte-caf5afe4-eb40-4d40-a255-d657e941f05b" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-75878f87-e01c-4586-ac0e-d45184ff7194 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-quobyte-caf5afe4-eb40-4d40-a255-d657e941f05b" acquired by "delete_volume" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4313341e-87bb-49c8-84d7-fc5bfb2eb759]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-75878f87-e01c-4586-ac0e-d45184ff7194 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-caf5afe4-eb40-4d40-a255-d657e941f05b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:45 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-08e1cad2-bdf5-4cf2-be0b-0ec77c413cd7 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.363s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-08e1cad2-bdf5-4cf2-be0b-0ec77c413cd7 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:17:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-08e1cad2-bdf5-4cf2-be0b-0ec77c413cd7 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Deleted volume successfully. Sep 01 12:17:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-08e1cad2-bdf5-4cf2-be0b-0ec77c413cd7 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-6dcb184e-78a7-4f01-8e02-59c584872685-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:17:45 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-caf5afe4-eb40-4d40-a255-d657e941f05b Sep 01 12:17:45 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:46 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9889deb8-c5b4-449a-84ce-5b37035cf92c 1073741824" returned: 0 in 0.685s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9889deb8-c5b4-449a-84ce-5b37035cf92c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:46 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9889deb8-c5b4-449a-84ce-5b37035cf92c Sep 01 12:17:46 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:46 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-75878f87-e01c-4586-ac0e-d45184ff7194 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-caf5afe4-eb40-4d40-a255-d657e941f05b" returned: 0 in 0.517s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-75878f87-e01c-4586-ac0e-d45184ff7194 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-caf5afe4-eb40-4d40-a255-d657e941f05b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:46 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-caf5afe4-eb40-4d40-a255-d657e941f05b Sep 01 12:17:46 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:46 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9889deb8-c5b4-449a-84ce-5b37035cf92c" returned: 0 in 0.364s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a1fcb2-dc12-4ff4-b1dd-668619cb1ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9889deb8-c5b4-449a-84ce-5b37035cf92c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdcf18fc-2269-4db6-861c-bb16edddfe47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:17:46 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Volume volume-9889deb8-c5b4-449a-84ce-5b37035cf92c (9889deb8-c5b4-449a-84ce-5b37035cf92c): created successfully Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdcf18fc-2269-4db6-861c-bb16edddfe47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Flow 'volume_create_manager' (080ddc23-b951-4312-ae9e-f975654a7824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:17:46 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5c9a03c7-ea06-4d52-9442-17f493ba9f49 tempest-VolumeQuotasAdminTestJSON-506138322 None] Created volume successfully. Sep 01 12:17:46 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-75878f87-e01c-4586-ac0e-d45184ff7194 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-caf5afe4-eb40-4d40-a255-d657e941f05b" returned: 0 in 0.299s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-75878f87-e01c-4586-ac0e-d45184ff7194 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-quobyte-caf5afe4-eb40-4d40-a255-d657e941f05b" released by "delete_volume" :: held 0.873s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-75878f87-e01c-4586-ac0e-d45184ff7194 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Created reservations ['90b9486f-dc64-4521-97dc-5888e55db3c8', '3b2d3d3b-6edd-4579-af6d-303521fc54ac', 'be236232-5adf-4ab8-8d19-e6d14c5354c5', 'e8e4b56c-59a9-4048-94bc-a954e1074463'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-75878f87-e01c-4586-ac0e-d45184ff7194 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-75878f87-e01c-4586-ac0e-d45184ff7194 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-75878f87-e01c-4586-ac0e-d45184ff7194 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-75878f87-e01c-4586-ac0e-d45184ff7194 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-75878f87-e01c-4586-ac0e-d45184ff7194 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-75878f87-e01c-4586-ac0e-d45184ff7194 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:46 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:17:46 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a90e51b1-da1e-4196-b474-c16426f09a76 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "cinder-2c577c54-472a-42c1-a405-50d6c5e2bbee-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a90e51b1-da1e-4196-b474-c16426f09a76 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-2c577c54-472a-42c1-a405-50d6c5e2bbee-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a90e51b1-da1e-4196-b474-c16426f09a76 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "cinder-quobyte-2c577c54-472a-42c1-a405-50d6c5e2bbee" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:17:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a90e51b1-da1e-4196-b474-c16426f09a76 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-quobyte-2c577c54-472a-42c1-a405-50d6c5e2bbee" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:17:47 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55b2fd2-9e8b-4d76-a80a-9bdd74edcec3]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:17:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a90e51b1-da1e-4196-b474-c16426f09a76 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2c577c54-472a-42c1-a405-50d6c5e2bbee {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:47 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-75878f87-e01c-4586-ac0e-d45184ff7194 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.425s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:47 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-75878f87-e01c-4586-ac0e-d45184ff7194 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:17:47 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2c577c54-472a-42c1-a405-50d6c5e2bbee Sep 01 12:17:47 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:47 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-75878f87-e01c-4586-ac0e-d45184ff7194 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Deleted volume successfully. Sep 01 12:17:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-75878f87-e01c-4586-ac0e-d45184ff7194 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-caf5afe4-eb40-4d40-a255-d657e941f05b-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:17:47 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a90e51b1-da1e-4196-b474-c16426f09a76 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2c577c54-472a-42c1-a405-50d6c5e2bbee" returned: 0 in 0.508s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a90e51b1-da1e-4196-b474-c16426f09a76 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2c577c54-472a-42c1-a405-50d6c5e2bbee {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:47 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2c577c54-472a-42c1-a405-50d6c5e2bbee Sep 01 12:17:47 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:47 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a90e51b1-da1e-4196-b474-c16426f09a76 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2c577c54-472a-42c1-a405-50d6c5e2bbee" returned: 0 in 0.390s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a90e51b1-da1e-4196-b474-c16426f09a76 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-quobyte-2c577c54-472a-42c1-a405-50d6c5e2bbee" released by "delete_volume" :: held 0.971s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:17:48 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a90e51b1-da1e-4196-b474-c16426f09a76 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Created reservations ['33d832cd-231a-4d24-8710-6496b81a7ad6', '54dd4a4b-849b-484a-8a1d-62fae933ff7c', '80a0eddd-23cc-4a1d-a4f9-cb0d8411c530', 'b8e1ea35-a045-4a4e-a49b-e4c9cc5c8a1c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:17:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a90e51b1-da1e-4196-b474-c16426f09a76 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a90e51b1-da1e-4196-b474-c16426f09a76 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a90e51b1-da1e-4196-b474-c16426f09a76 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:17:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a90e51b1-da1e-4196-b474-c16426f09a76 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:17:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a90e51b1-da1e-4196-b474-c16426f09a76 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a90e51b1-da1e-4196-b474-c16426f09a76 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:48 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:17:48 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:48 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a90e51b1-da1e-4196-b474-c16426f09a76 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.399s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:48 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-a90e51b1-da1e-4196-b474-c16426f09a76 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:17:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a90e51b1-da1e-4196-b474-c16426f09a76 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Deleted volume successfully. Sep 01 12:17:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-68ee13b4-ad75-4eaa-996b-d43f547ac1b6 tempest-VolumeQuotasAdminTestJSON-1661554913 None] Transfer volume completed successfully. Sep 01 12:17:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-730801f2-31f5-4cb9-b53e-a84b0dc793c1 req-2f06a324-9fed-46e0-b114-c1bb964b830e tempest-TestShelveInstance-1786574594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-730801f2-31f5-4cb9-b53e-a84b0dc793c1 req-2f06a324-9fed-46e0-b114-c1bb964b830e tempest-TestShelveInstance-1786574594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a90e51b1-da1e-4196-b474-c16426f09a76 tempest-CreateVolumesFromSourceVolumeTest-2042254713 None] Lock "cinder-2c577c54-472a-42c1-a405-50d6c5e2bbee-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:17:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-730801f2-31f5-4cb9-b53e-a84b0dc793c1 req-2f06a324-9fed-46e0-b114-c1bb964b830e tempest-TestShelveInstance-1786574594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.053s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-730801f2-31f5-4cb9-b53e-a84b0dc793c1 req-2f06a324-9fed-46e0-b114-c1bb964b830e tempest-TestShelveInstance-1786574594 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '286c345e-4a01-4ccf-9d41-a950128770e4', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:17:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-730801f2-31f5-4cb9-b53e-a84b0dc793c1 req-2f06a324-9fed-46e0-b114-c1bb964b830e tempest-TestShelveInstance-1786574594 None] attachment_update completed successfully. Sep 01 12:17:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-781242d1-2b58-4ad5-9593-1d563e44b920 tempest-VolumeQuotasAdminTestJSON-58796743 None] Acquiring lock "cinder-9889deb8-c5b4-449a-84ce-5b37035cf92c-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:17:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-781242d1-2b58-4ad5-9593-1d563e44b920 tempest-VolumeQuotasAdminTestJSON-58796743 None] Lock "cinder-9889deb8-c5b4-449a-84ce-5b37035cf92c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:17:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-b0f43503-220a-453d-90c8-f3dbc4b67a5a req-f13accce-355f-417a-95e5-19c48170ac41 tempest-TestInstancesWithCinderVolumes-1035486613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-b0f43503-220a-453d-90c8-f3dbc4b67a5a req-f13accce-355f-417a-95e5-19c48170ac41 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-b0f43503-220a-453d-90c8-f3dbc4b67a5a req-f13accce-355f-417a-95e5-19c48170ac41 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-781242d1-2b58-4ad5-9593-1d563e44b920 tempest-VolumeQuotasAdminTestJSON-58796743 None] Acquiring lock "cinder-quobyte-9889deb8-c5b4-449a-84ce-5b37035cf92c" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:17:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-781242d1-2b58-4ad5-9593-1d563e44b920 tempest-VolumeQuotasAdminTestJSON-58796743 None] Lock "cinder-quobyte-9889deb8-c5b4-449a-84ce-5b37035cf92c" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:17:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-b0f43503-220a-453d-90c8-f3dbc4b67a5a req-f13accce-355f-417a-95e5-19c48170ac41 tempest-TestInstancesWithCinderVolumes-1035486613 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6b24771-edd4-4d09-96cb-ddf4b73347ee', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:17:49 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba666760-24a7-498a-93c3-ceb7d6c9bca8]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:17:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-781242d1-2b58-4ad5-9593-1d563e44b920 tempest-VolumeQuotasAdminTestJSON-58796743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9889deb8-c5b4-449a-84ce-5b37035cf92c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:50 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-b0f43503-220a-453d-90c8-f3dbc4b67a5a req-f13accce-355f-417a-95e5-19c48170ac41 tempest-TestInstancesWithCinderVolumes-1035486613 None] attachment_update completed successfully. Sep 01 12:17:50 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9889deb8-c5b4-449a-84ce-5b37035cf92c Sep 01 12:17:50 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:50 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-781242d1-2b58-4ad5-9593-1d563e44b920 tempest-VolumeQuotasAdminTestJSON-58796743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9889deb8-c5b4-449a-84ce-5b37035cf92c" returned: 0 in 0.549s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-781242d1-2b58-4ad5-9593-1d563e44b920 tempest-VolumeQuotasAdminTestJSON-58796743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9889deb8-c5b4-449a-84ce-5b37035cf92c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:50 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9889deb8-c5b4-449a-84ce-5b37035cf92c Sep 01 12:17:50 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:50 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-781242d1-2b58-4ad5-9593-1d563e44b920 tempest-VolumeQuotasAdminTestJSON-58796743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9889deb8-c5b4-449a-84ce-5b37035cf92c" returned: 0 in 0.311s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-781242d1-2b58-4ad5-9593-1d563e44b920 tempest-VolumeQuotasAdminTestJSON-58796743 None] Lock "cinder-quobyte-9889deb8-c5b4-449a-84ce-5b37035cf92c" released by "delete_volume" :: held 0.938s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:17:50 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-781242d1-2b58-4ad5-9593-1d563e44b920 tempest-VolumeQuotasAdminTestJSON-58796743 None] Created reservations ['f595263c-0ab7-4704-aee4-f57ef1f1ff60', '1e99d294-6111-451d-ac7d-68f12ba61f2c', 'd7ffff68-a3be-43e1-9617-08971c875576', 'ebb6bb16-88e0-4f41-9ffb-dd61c74d0f34'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:17:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-781242d1-2b58-4ad5-9593-1d563e44b920 tempest-VolumeQuotasAdminTestJSON-58796743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:17:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-781242d1-2b58-4ad5-9593-1d563e44b920 tempest-VolumeQuotasAdminTestJSON-58796743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:17:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-781242d1-2b58-4ad5-9593-1d563e44b920 tempest-VolumeQuotasAdminTestJSON-58796743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:17:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-781242d1-2b58-4ad5-9593-1d563e44b920 tempest-VolumeQuotasAdminTestJSON-58796743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:17:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-781242d1-2b58-4ad5-9593-1d563e44b920 tempest-VolumeQuotasAdminTestJSON-58796743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:17:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-781242d1-2b58-4ad5-9593-1d563e44b920 tempest-VolumeQuotasAdminTestJSON-58796743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:17:50 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:17:50 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:17:51 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Sep 01 12:17:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-781242d1-2b58-4ad5-9593-1d563e44b920 tempest-VolumeQuotasAdminTestJSON-58796743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.251s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:17:51 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-781242d1-2b58-4ad5-9593-1d563e44b920 tempest-VolumeQuotasAdminTestJSON-58796743 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:17:51 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-781242d1-2b58-4ad5-9593-1d563e44b920 tempest-VolumeQuotasAdminTestJSON-58796743 None] Deleted volume successfully. Sep 01 12:17:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-781242d1-2b58-4ad5-9593-1d563e44b920 tempest-VolumeQuotasAdminTestJSON-58796743 None] Lock "cinder-9889deb8-c5b4-449a-84ce-5b37035cf92c-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:00 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:18:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Flow 'volume_create_manager' (88930d0c-298c-4646-8497-c4fbcbc95599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:18:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10638921-1559-4a19-a6c3-82e363feef2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10638921-1559-4a19-a6c3-82e363feef2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc47164-c94c-4074-b8c7-80ad2105c8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b6b28b3fad4546a4287bd3075f0178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:18:01Z,use_quota=True,user_id='e684c703725e439e9881aa3bace64eb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843327ab-a314-4b37-8f8d-456119843783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843327ab-a314-4b37-8f8d-456119843783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3792b510-033e-4967-974c-82f5a93a94f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:00 devstack cinder-volume[87084]: DEBUG cinder.image.glance [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Creating Keystone auth plugin from conf {{(pid=87084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 12:18:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3792b510-033e-4967-974c-82f5a93a94f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bcc47164-c94c-4074-b8c7-80ad2105c8d4', 'volume_name': 'volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4', 'volume_size': 1, 'image_id': 'a52b0800-80a4-4437-8530-190aaee92caa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a52b0800-80a4-4437-8530-190aaee92caa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ecafe6b2c6de0732d67340f6e493adbf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3b6b28b3fad4546a4287bd3075f0178', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1cf0c298040444ad9746e421de4eae8112324db3122f6e3872da893e4f341c8932f7b0a2882a9aac1156720ff6fdb57a9ac48fd670b63f641b07db798b83be78', 'id': 'a52b0800-80a4-4437-8530-190aaee92caa', 'created_at': datetime.datetime(2026, 9, 1, 10, 17, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 17, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a52b0800-80a4-4437-8530-190aaee92caa/file', 'properties': {}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1cdd429-3412-448d-9cbf-c930f16d8092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1cdd429-3412-448d-9cbf-c930f16d8092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95dd800-4efa-4e63-83cc-c7ea8b56b3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:01 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Volume bcc47164-c94c-4074-b8c7-80ad2105c8d4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4', 'volume_size': 1, 'image_id': 'a52b0800-80a4-4437-8530-190aaee92caa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a52b0800-80a4-4437-8530-190aaee92caa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ecafe6b2c6de0732d67340f6e493adbf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3b6b28b3fad4546a4287bd3075f0178', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1cf0c298040444ad9746e421de4eae8112324db3122f6e3872da893e4f341c8932f7b0a2882a9aac1156720ff6fdb57a9ac48fd670b63f641b07db798b83be78', 'id': 'a52b0800-80a4-4437-8530-190aaee92caa', 'created_at': datetime.datetime(2026, 9, 1, 10, 17, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 17, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a52b0800-80a4-4437-8530-190aaee92caa/file', 'properties': {}}, 'image_service': } Sep 01 12:18:01 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Trying to clone bcc47164-c94c-4074-b8c7-80ad2105c8d4 from image a52b0800-80a4-4437-8530-190aaee92caa at location (None, [{'url': 'file:///opt/stack/data/glance/images/a52b0800-80a4-4437-8530-190aaee92caa', 'metadata': {}}]). {{(pid=87084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 12:18:01 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 12:18:01 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Image download 0.00 MB at 0.00 MB/s Sep 01 12:18:01 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a091077-d526-46f1-a2f1-e9c0044361a6]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:18:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:02 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD Sep 01 12:18:02 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:02 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD" returned: 0 in 0.836s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:02 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD Sep 01 12:18:02 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:03 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD" returned: 1 in 0.452s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:18:03 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Temporary image a52b0800-80a4-4437-8530-190aaee92caa is fetched for user e684c703725e439e9881aa3bace64eb5. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 12:18:03 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bee4b8a-4c20-4fde-ab9b-958a322ab8b1]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:18:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:03 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD Sep 01 12:18:03 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:04 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD" returned: 0 in 1.042s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:04 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD Sep 01 12:18:04 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:05 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD" returned: 1 in 0.861s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:18:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc47164-c94c-4074-b8c7-80ad2105c8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b6b28b3fad4546a4287bd3075f0178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:18:01Z,use_quota=True,user_id='e684c703725e439e9881aa3bace64eb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:18:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Creating volume bcc47164-c94c-4074-b8c7-80ad2105c8d4 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:18:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:18:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:18:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:18:05 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:18:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:05 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4 1073741824 Sep 01 12:18:05 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:06 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4 1073741824" returned: 0 in 0.930s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:06 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4 Sep 01 12:18:06 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:06 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4" returned: 0 in 0.554s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:18:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:07 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Attempting download of a52b0800-80a4-4437-8530-190aaee92caa ((None, [{'url': 'file:///opt/stack/data/glance/images/a52b0800-80a4-4437-8530-190aaee92caa', 'metadata': {}}])) to volume bcc47164-c94c-4074-b8c7-80ad2105c8d4. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 12:18:07 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80bab02-f67a-4f79-8dd2-948815550e1e]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:18:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a52b0800-80a4-4437-8530-190aaee92caa_3k06hiq8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:07 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a52b0800-80a4-4437-8530-190aaee92caa_3k06hiq8 Sep 01 12:18:07 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:07 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a52b0800-80a4-4437-8530-190aaee92caa_3k06hiq8" returned: 0 in 0.647s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a52b0800-80a4-4437-8530-190aaee92caa_3k06hiq8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:07 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a52b0800-80a4-4437-8530-190aaee92caa_3k06hiq8 Sep 01 12:18:07 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:08 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a52b0800-80a4-4437-8530-190aaee92caa_3k06hiq8" returned: 1 in 0.375s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a52b0800-80a4-4437-8530-190aaee92caa_3k06hiq8' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:18:08 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a3650c-e543-45c3-b7ac-ad99f5ef173c]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:18:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:08 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD Sep 01 12:18:08 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:09 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD" returned: 0 in 1.024s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:09 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD Sep 01 12:18:09 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:09 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD" returned: 1 in 0.681s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:18:09 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] a52b0800-80a4-4437-8530-190aaee92caa was raw, converting to qcow2 {{(pid=87084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 12:18:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:09 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4 Sep 01 12:18:09 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Flow 'volume_create_manager' (c65b5d72-bbd3-4222-a6db-9b3ee14bacf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff609627-5e94-4d7e-8ed6-2d4d9ac475f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff609627-5e94-4d7e-8ed6-2d4d9ac475f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1978810729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408e2163-8d79-43d1-82f8-1d27f15bad15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa38d6b5bd054654b6dd0fdc7a271e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:18:10Z,use_quota=True,user_id='bd1ba18d315b439e8186fb5816296861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd3bacd-080d-4f3b-8cb1-d1418bb73056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd3bacd-080d-4f3b-8cb1-d1418bb73056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9be208-5c53-4793-ae3a-61ce25d69a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9be208-5c53-4793-ae3a-61ce25d69a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '408e2163-8d79-43d1-82f8-1d27f15bad15', 'volume_name': 'volume-408e2163-8d79-43d1-82f8-1d27f15bad15', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d4b5b4-0d31-40a9-9178-416794da96a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d4b5b4-0d31-40a9-9178-416794da96a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7d667e-cbf4-4f9b-b080-1407bf95475e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:10 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Volume 408e2163-8d79-43d1-82f8-1d27f15bad15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-408e2163-8d79-43d1-82f8-1d27f15bad15', 'volume_size': 1} Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1978810729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408e2163-8d79-43d1-82f8-1d27f15bad15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa38d6b5bd054654b6dd0fdc7a271e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:18:10Z,use_quota=True,user_id='bd1ba18d315b439e8186fb5816296861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Creating volume 408e2163-8d79-43d1-82f8-1d27f15bad15 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:18:10 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-408e2163-8d79-43d1-82f8-1d27f15bad15 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:10 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-408e2163-8d79-43d1-82f8-1d27f15bad15 1073741824 Sep 01 12:18:10 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:10 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4" returned: 0 in 1.079s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a52b0800-80a4-4437-8530-190aaee92caa_5543p0fvdevstack@QuobyteHD, size 0.00 MB, duration 1.08 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:18:10 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 12:18:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:11 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4 1G Sep 01 12:18:11 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:11 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-408e2163-8d79-43d1-82f8-1d27f15bad15 1073741824" returned: 0 in 0.793s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:11 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4 1G" returned: 0 in 0.604s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:11 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Downloaded image a52b0800-80a4-4437-8530-190aaee92caa ((None, [{'url': 'file:///opt/stack/data/glance/images/a52b0800-80a4-4437-8530-190aaee92caa', 'metadata': {}}])) to volume bcc47164-c94c-4074-b8c7-80ad2105c8d4 successfully. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 12:18:11 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Temporary image a52b0800-80a4-4437-8530-190aaee92caa for user e684c703725e439e9881aa3bace64eb5 is deleted. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 12:18:11 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Marking volume bcc47164-c94c-4074-b8c7-80ad2105c8d4 as bootable. {{(pid=87084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 12:18:11 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Copying metadata from image a52b0800-80a4-4437-8530-190aaee92caa to bcc47164-c94c-4074-b8c7-80ad2105c8d4. {{(pid=87084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 12:18:11 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Creating volume glance metadata for volume bcc47164-c94c-4074-b8c7-80ad2105c8d4 backed by image a52b0800-80a4-4437-8530-190aaee92caa with: {'image_id': 'a52b0800-80a4-4437-8530-190aaee92caa', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ecafe6b2c6de0732d67340f6e493adbf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 12:18:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-408e2163-8d79-43d1-82f8-1d27f15bad15 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:11 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-408e2163-8d79-43d1-82f8-1d27f15bad15 Sep 01 12:18:11 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95dd800-4efa-4e63-83cc-c7ea8b56b3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4', 'volume_size': 1, 'image_id': 'a52b0800-80a4-4437-8530-190aaee92caa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a52b0800-80a4-4437-8530-190aaee92caa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ecafe6b2c6de0732d67340f6e493adbf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3b6b28b3fad4546a4287bd3075f0178', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1cf0c298040444ad9746e421de4eae8112324db3122f6e3872da893e4f341c8932f7b0a2882a9aac1156720ff6fdb57a9ac48fd670b63f641b07db798b83be78', 'id': 'a52b0800-80a4-4437-8530-190aaee92caa', 'created_at': datetime.datetime(2026, 9, 1, 10, 17, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 17, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a52b0800-80a4-4437-8530-190aaee92caa/file', 'properties': {}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de64dd8-a949-4d65-8087-43b73ede9654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:11 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Volume volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4 (bcc47164-c94c-4074-b8c7-80ad2105c8d4): created successfully Sep 01 12:18:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de64dd8-a949-4d65-8087-43b73ede9654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Flow 'volume_create_manager' (88930d0c-298c-4646-8497-c4fbcbc95599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:18:11 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-67987bef-d69a-4124-ad29-88e68bfd25da tempest-VolumeImageDependencyTests-1576141414 None] Created volume successfully. Sep 01 12:18:12 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-408e2163-8d79-43d1-82f8-1d27f15bad15" returned: 0 in 0.452s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:18:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7d667e-cbf4-4f9b-b080-1407bf95475e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-408e2163-8d79-43d1-82f8-1d27f15bad15', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5758189c-5b72-4ce4-b5ec-b8c3a045cc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:12 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Volume volume-408e2163-8d79-43d1-82f8-1d27f15bad15 (408e2163-8d79-43d1-82f8-1d27f15bad15): created successfully Sep 01 12:18:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5758189c-5b72-4ce4-b5ec-b8c3a045cc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Flow 'volume_create_manager' (c65b5d72-bbd3-4222-a6db-9b3ee14bacf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:18:12 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-450e69ab-2d70-441a-9039-1fa52d6d35d9 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Created volume successfully. Sep 01 12:18:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1879d1ef-73e4-4dfe-bee9-b6131b179e88 tempest-VolumeImageDependencyTests-1576141414 None] Acquiring lock "cinder-bcc47164-c94c-4074-b8c7-80ad2105c8d4-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1879d1ef-73e4-4dfe-bee9-b6131b179e88 tempest-VolumeImageDependencyTests-1576141414 None] Lock "cinder-bcc47164-c94c-4074-b8c7-80ad2105c8d4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1879d1ef-73e4-4dfe-bee9-b6131b179e88 tempest-VolumeImageDependencyTests-1576141414 None] Acquiring lock "cinder-quobyte-bcc47164-c94c-4074-b8c7-80ad2105c8d4" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1879d1ef-73e4-4dfe-bee9-b6131b179e88 tempest-VolumeImageDependencyTests-1576141414 None] Lock "cinder-quobyte-bcc47164-c94c-4074-b8c7-80ad2105c8d4" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:12 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ed5e56-efae-4792-b565-c64bddbd146e]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:18:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1879d1ef-73e4-4dfe-bee9-b6131b179e88 tempest-VolumeImageDependencyTests-1576141414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:12 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4 Sep 01 12:18:12 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:13 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1879d1ef-73e4-4dfe-bee9-b6131b179e88 tempest-VolumeImageDependencyTests-1576141414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4" returned: 0 in 0.718s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1879d1ef-73e4-4dfe-bee9-b6131b179e88 tempest-VolumeImageDependencyTests-1576141414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:13 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4 Sep 01 12:18:13 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:13 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1879d1ef-73e4-4dfe-bee9-b6131b179e88 tempest-VolumeImageDependencyTests-1576141414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bcc47164-c94c-4074-b8c7-80ad2105c8d4" returned: 0 in 0.460s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1879d1ef-73e4-4dfe-bee9-b6131b179e88 tempest-VolumeImageDependencyTests-1576141414 None] Lock "cinder-quobyte-bcc47164-c94c-4074-b8c7-80ad2105c8d4" released by "delete_volume" :: held 1.269s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:13 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-1879d1ef-73e4-4dfe-bee9-b6131b179e88 tempest-VolumeImageDependencyTests-1576141414 None] Created reservations ['4372544b-afd5-45e2-b512-c4834127bf0c', 'fe32c4c1-ff03-473b-82e0-7afaba8e120d', '5d472057-866e-4bf6-b028-733a4f87fe2f', '078bd430-6945-430a-8cda-3bc64f6e8757'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:18:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1879d1ef-73e4-4dfe-bee9-b6131b179e88 tempest-VolumeImageDependencyTests-1576141414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1879d1ef-73e4-4dfe-bee9-b6131b179e88 tempest-VolumeImageDependencyTests-1576141414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1879d1ef-73e4-4dfe-bee9-b6131b179e88 tempest-VolumeImageDependencyTests-1576141414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:18:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1879d1ef-73e4-4dfe-bee9-b6131b179e88 tempest-VolumeImageDependencyTests-1576141414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:18:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1879d1ef-73e4-4dfe-bee9-b6131b179e88 tempest-VolumeImageDependencyTests-1576141414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1879d1ef-73e4-4dfe-bee9-b6131b179e88 tempest-VolumeImageDependencyTests-1576141414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:14 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:18:14 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:14 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1879d1ef-73e4-4dfe-bee9-b6131b179e88 tempest-VolumeImageDependencyTests-1576141414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.539s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:14 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-1879d1ef-73e4-4dfe-bee9-b6131b179e88 tempest-VolumeImageDependencyTests-1576141414 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:18:14 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1879d1ef-73e4-4dfe-bee9-b6131b179e88 tempest-VolumeImageDependencyTests-1576141414 None] Deleted volume successfully. Sep 01 12:18:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1879d1ef-73e4-4dfe-bee9-b6131b179e88 tempest-VolumeImageDependencyTests-1576141414 None] Lock "cinder-bcc47164-c94c-4074-b8c7-80ad2105c8d4-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f58ffe08-c0d2-47b6-8cad-16f804c71775 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Acquiring lock "cinder-408e2163-8d79-43d1-82f8-1d27f15bad15-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f58ffe08-c0d2-47b6-8cad-16f804c71775 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Lock "cinder-408e2163-8d79-43d1-82f8-1d27f15bad15-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f58ffe08-c0d2-47b6-8cad-16f804c71775 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Acquiring lock "cinder-quobyte-408e2163-8d79-43d1-82f8-1d27f15bad15" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f58ffe08-c0d2-47b6-8cad-16f804c71775 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Lock "cinder-quobyte-408e2163-8d79-43d1-82f8-1d27f15bad15" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a99578-9529-4623-a20a-32fa7304cad9]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:18:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f58ffe08-c0d2-47b6-8cad-16f804c71775 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-408e2163-8d79-43d1-82f8-1d27f15bad15 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:15 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-408e2163-8d79-43d1-82f8-1d27f15bad15 Sep 01 12:18:15 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:15 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f58ffe08-c0d2-47b6-8cad-16f804c71775 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-408e2163-8d79-43d1-82f8-1d27f15bad15" returned: 0 in 0.464s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f58ffe08-c0d2-47b6-8cad-16f804c71775 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-408e2163-8d79-43d1-82f8-1d27f15bad15 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:15 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-408e2163-8d79-43d1-82f8-1d27f15bad15 Sep 01 12:18:15 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:15 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f58ffe08-c0d2-47b6-8cad-16f804c71775 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-408e2163-8d79-43d1-82f8-1d27f15bad15" returned: 0 in 0.320s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f58ffe08-c0d2-47b6-8cad-16f804c71775 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Lock "cinder-quobyte-408e2163-8d79-43d1-82f8-1d27f15bad15" released by "delete_volume" :: held 0.854s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:15 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-f58ffe08-c0d2-47b6-8cad-16f804c71775 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Created reservations ['8778b80b-3693-47bf-940a-58a880ac8682', '6653c894-02d4-4cea-a797-a962bac14f53', 'a81261ee-a297-43cb-b1cc-8d3a03b30f9c', '4661148e-7fff-43c0-8093-a895a9db7ba1'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:18:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f58ffe08-c0d2-47b6-8cad-16f804c71775 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f58ffe08-c0d2-47b6-8cad-16f804c71775 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f58ffe08-c0d2-47b6-8cad-16f804c71775 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:18:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f58ffe08-c0d2-47b6-8cad-16f804c71775 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:18:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f58ffe08-c0d2-47b6-8cad-16f804c71775 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f58ffe08-c0d2-47b6-8cad-16f804c71775 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:16 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:18:16 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:16 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f58ffe08-c0d2-47b6-8cad-16f804c71775 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.594s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:16 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-f58ffe08-c0d2-47b6-8cad-16f804c71775 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:18:16 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f58ffe08-c0d2-47b6-8cad-16f804c71775 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Deleted volume successfully. Sep 01 12:18:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f58ffe08-c0d2-47b6-8cad-16f804c71775 tempest-VolumeQuotasNegativeTestJSON-1421646161 None] Lock "cinder-408e2163-8d79-43d1-82f8-1d27f15bad15-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Flow 'volume_create_manager' (39d60ca0-154f-4268-ac62-5384b2f4a1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c49eabf-32e1-4e52-a996-56c4e06bac38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c49eabf-32e1-4e52-a996-56c4e06bac38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241f7949-fe12-4494-86e1-e5ed706bda3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c21fd209b944c0b8a76d1dfdbd0f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:18:19Z,use_quota=True,user_id='f2be738ddd3e4752919114e9b6b3a6a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d567aee6-8b89-436a-92f7-b075e4541588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d567aee6-8b89-436a-92f7-b075e4541588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4ef388-485b-45a8-af4e-4e537268a6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4ef388-485b-45a8-af4e-4e537268a6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '241f7949-fe12-4494-86e1-e5ed706bda3d', 'volume_name': 'volume-241f7949-fe12-4494-86e1-e5ed706bda3d', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68078ac0-017f-4d59-a6bf-7dd05f287d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68078ac0-017f-4d59-a6bf-7dd05f287d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e3520a-0c85-4ee3-82f3-223dbe5e5270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:19 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Volume 241f7949-fe12-4494-86e1-e5ed706bda3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-241f7949-fe12-4494-86e1-e5ed706bda3d', 'volume_size': 1} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241f7949-fe12-4494-86e1-e5ed706bda3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c21fd209b944c0b8a76d1dfdbd0f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:18:19Z,use_quota=True,user_id='f2be738ddd3e4752919114e9b6b3a6a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Creating volume 241f7949-fe12-4494-86e1-e5ed706bda3d {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:18:19 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-241f7949-fe12-4494-86e1-e5ed706bda3d 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:19 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-241f7949-fe12-4494-86e1-e5ed706bda3d 1073741824 Sep 01 12:18:19 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:19 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-241f7949-fe12-4494-86e1-e5ed706bda3d 1073741824" returned: 0 in 0.528s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-241f7949-fe12-4494-86e1-e5ed706bda3d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:19 devstack sudo[101227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-241f7949-fe12-4494-86e1-e5ed706bda3d Sep 01 12:18:19 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:20 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-241f7949-fe12-4494-86e1-e5ed706bda3d" returned: 0 in 0.262s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:18:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e3520a-0c85-4ee3-82f3-223dbe5e5270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-241f7949-fe12-4494-86e1-e5ed706bda3d', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1932af0e-b8ab-494b-aa4a-2c715e0b1c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:20 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Volume volume-241f7949-fe12-4494-86e1-e5ed706bda3d (241f7949-fe12-4494-86e1-e5ed706bda3d): created successfully Sep 01 12:18:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1932af0e-b8ab-494b-aa4a-2c715e0b1c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:20 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Flow 'volume_create_manager' (39d60ca0-154f-4268-ac62-5384b2f4a1a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:18:20 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1d4f35cf-4d97-40fb-ba0c-bde3ef3406c7 tempest-CinderUnicodeTest-1937926506 None] Created volume successfully. Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Flow 'volume_create_manager' (d3a86e6d-72de-4c72-a0c6-d319b7918e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b24ce23a-a3b3-4567-aabf-b5458fb0f905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b24ce23a-a3b3-4567-aabf-b5458fb0f905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:18:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1383766694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4365717-e9c5-4af8-bf9a-ba4cc513e368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c21fd209b944c0b8a76d1dfdbd0f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:18:22Z,use_quota=True,user_id='f2be738ddd3e4752919114e9b6b3a6a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db57bc53-74ff-45d4-8056-fa9a27eea011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db57bc53-74ff-45d4-8056-fa9a27eea011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46d4d41-eba3-40c2-8109-ed065fa5a284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46d4d41-eba3-40c2-8109-ed065fa5a284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4365717-e9c5-4af8-bf9a-ba4cc513e368', 'volume_name': 'volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9327102-c0fd-43c2-8914-6ea7297b35f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9327102-c0fd-43c2-8914-6ea7297b35f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202cff90-9ab7-4d1a-a5bf-581a130b505a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:21 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Volume f4365717-e9c5-4af8-bf9a-ba4cc513e368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368', 'volume_size': 1} Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:18:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1383766694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4365717-e9c5-4af8-bf9a-ba4cc513e368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c21fd209b944c0b8a76d1dfdbd0f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:18:22Z,use_quota=True,user_id='f2be738ddd3e4752919114e9b6b3a6a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Creating volume f4365717-e9c5-4af8-bf9a-ba4cc513e368 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:18:21 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:18:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:21 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368 1073741824 Sep 01 12:18:21 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:22 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368 1073741824" returned: 0 in 0.445s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:22 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368 Sep 01 12:18:22 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:22 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368" returned: 0 in 0.254s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:18:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202cff90-9ab7-4d1a-a5bf-581a130b505a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85cedc6f-8b08-4b34-89f1-0ad50070561c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:22 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Volume volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368 (f4365717-e9c5-4af8-bf9a-ba4cc513e368): created successfully Sep 01 12:18:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85cedc6f-8b08-4b34-89f1-0ad50070561c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Flow 'volume_create_manager' (d3a86e6d-72de-4c72-a0c6-d319b7918e6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:18:22 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5ce16f1d-04d9-432b-bb34-cd548e373219 tempest-CinderUnicodeTest-1937926506 None] Created volume successfully. Sep 01 12:18:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-658c93c2-e22c-4995-8821-fc41cb62750d tempest-CinderUnicodeTest-1937926506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-658c93c2-e22c-4995-8821-fc41cb62750d tempest-CinderUnicodeTest-1937926506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:23 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:18:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Flow 'volume_create_manager' (924fdafd-eefd-4b2d-bc69-bc9653ed3d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:18:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc300fa5-1fb0-4cfb-b8a8-1b806b80361f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-658c93c2-e22c-4995-8821-fc41cb62750d tempest-CinderUnicodeTest-1937926506 None] Creating offline snapshot bece9a02-5eab-4501-ad63-b21846c437b1 of volume f4365717-e9c5-4af8-bf9a-ba4cc513e368 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:18:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc300fa5-1fb0-4cfb-b8a8-1b806b80361f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1614909962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318a08aa-5433-46a2-840e-21fb6802812e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50fc29e618c1481985c7c77efb4c9576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:18:23Z,use_quota=True,user_id='24fdf933eb6048d9b6dcc43e6cd341eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4aba76a-8de5-4b7c-a85e-692041a79d10),volume_type_id=b4aba76a-8de5-4b7c-a85e-692041a79d10)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1bf7238-3eeb-4b2c-91ec-dcdc0331cc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1bf7238-3eeb-4b2c-91ec-dcdc0331cc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963a48ba-e8d6-4d35-a626-c6f01ade190d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963a48ba-e8d6-4d35-a626-c6f01ade190d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '318a08aa-5433-46a2-840e-21fb6802812e', 'volume_name': 'volume-318a08aa-5433-46a2-840e-21fb6802812e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (916405f0-16bc-44fa-9d59-ebb660cc2ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (916405f0-16bc-44fa-9d59-ebb660cc2ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c19d7a9-54e3-4301-9a77-16d9b33aad8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:23 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Volume 318a08aa-5433-46a2-840e-21fb6802812e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-318a08aa-5433-46a2-840e-21fb6802812e', 'volume_size': 1} Sep 01 12:18:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:23 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dd09fd-afae-4a8e-95c1-9f39cd82f0d9]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:18:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-658c93c2-e22c-4995-8821-fc41cb62750d tempest-CinderUnicodeTest-1937926506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:23 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368 Sep 01 12:18:23 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:23 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-658c93c2-e22c-4995-8821-fc41cb62750d tempest-CinderUnicodeTest-1937926506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368" returned: 0 in 0.386s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-658c93c2-e22c-4995-8821-fc41cb62750d tempest-CinderUnicodeTest-1937926506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.bece9a02-5eab-4501-ad63-b21846c437b1 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:23 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.bece9a02-5eab-4501-ad63-b21846c437b1 1G Sep 01 12:18:23 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:24 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-658c93c2-e22c-4995-8821-fc41cb62750d tempest-CinderUnicodeTest-1937926506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.bece9a02-5eab-4501-ad63-b21846c437b1 1G" returned: 0 in 0.415s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-658c93c2-e22c-4995-8821-fc41cb62750d tempest-CinderUnicodeTest-1937926506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.bece9a02-5eab-4501-ad63-b21846c437b1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:24 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.bece9a02-5eab-4501-ad63-b21846c437b1 Sep 01 12:18:24 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:24 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-658c93c2-e22c-4995-8821-fc41cb62750d tempest-CinderUnicodeTest-1937926506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.bece9a02-5eab-4501-ad63-b21846c437b1" returned: 0 in 0.310s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:24 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-658c93c2-e22c-4995-8821-fc41cb62750d tempest-CinderUnicodeTest-1937926506 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.bece9a02-5eab-4501-ad63-b21846c437b1 is being set with open permissions: ugo+rw Sep 01 12:18:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-658c93c2-e22c-4995-8821-fc41cb62750d tempest-CinderUnicodeTest-1937926506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.bece9a02-5eab-4501-ad63-b21846c437b1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:24 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.bece9a02-5eab-4501-ad63-b21846c437b1 Sep 01 12:18:24 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:24 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-658c93c2-e22c-4995-8821-fc41cb62750d tempest-CinderUnicodeTest-1937926506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.bece9a02-5eab-4501-ad63-b21846c437b1" returned: 0 in 0.253s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-658c93c2-e22c-4995-8821-fc41cb62750d tempest-CinderUnicodeTest-1937926506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:24 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.info Sep 01 12:18:24 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:24 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-658c93c2-e22c-4995-8821-fc41cb62750d tempest-CinderUnicodeTest-1937926506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.info" returned: 0 in 0.274s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:24 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-658c93c2-e22c-4995-8821-fc41cb62750d tempest-CinderUnicodeTest-1937926506 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.info is being set with open permissions: ugo+rw Sep 01 12:18:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-658c93c2-e22c-4995-8821-fc41cb62750d tempest-CinderUnicodeTest-1937926506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:24 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.info Sep 01 12:18:24 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:25 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-658c93c2-e22c-4995-8821-fc41cb62750d tempest-CinderUnicodeTest-1937926506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.info" returned: 0 in 0.295s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-658c93c2-e22c-4995-8821-fc41cb62750d tempest-CinderUnicodeTest-1937926506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.003s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1614909962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318a08aa-5433-46a2-840e-21fb6802812e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50fc29e618c1481985c7c77efb4c9576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:18:23Z,use_quota=True,user_id='24fdf933eb6048d9b6dcc43e6cd341eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4aba76a-8de5-4b7c-a85e-692041a79d10),volume_type_id=b4aba76a-8de5-4b7c-a85e-692041a79d10)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:18:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Creating volume 318a08aa-5433-46a2-840e-21fb6802812e {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:18:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:18:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:18:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:18:25 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:18:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-318a08aa-5433-46a2-840e-21fb6802812e 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:25 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-318a08aa-5433-46a2-840e-21fb6802812e 1073741824 Sep 01 12:18:25 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:25 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-658c93c2-e22c-4995-8821-fc41cb62750d tempest-CinderUnicodeTest-1937926506 None] Create snapshot completed successfully Sep 01 12:18:25 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-318a08aa-5433-46a2-840e-21fb6802812e 1073741824" returned: 0 in 0.440s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-318a08aa-5433-46a2-840e-21fb6802812e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:25 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-318a08aa-5433-46a2-840e-21fb6802812e Sep 01 12:18:25 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:26 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-318a08aa-5433-46a2-840e-21fb6802812e" returned: 0 in 0.272s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c19d7a9-54e3-4301-9a77-16d9b33aad8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-318a08aa-5433-46a2-840e-21fb6802812e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b2f20d-756c-4f83-a6ae-a1c4e8356ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:26 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Volume volume-318a08aa-5433-46a2-840e-21fb6802812e (318a08aa-5433-46a2-840e-21fb6802812e): created successfully Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b2f20d-756c-4f83-a6ae-a1c4e8356ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Flow 'volume_create_manager' (924fdafd-eefd-4b2d-bc69-bc9653ed3d6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:18:26 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-aacab119-c44b-4926-94ac-61189bef52c2 tempest-VolumeTypesAccessTest-1859617084 None] Created volume successfully. Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] Acquiring lock "cinder-bece9a02-5eab-4501-ad63-b21846c437b1-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] Lock "cinder-bece9a02-5eab-4501-ad63-b21846c437b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] Acquiring lock "cinder-quobyte-f4365717-e9c5-4af8-bf9a-ba4cc513e368" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] Lock "cinder-quobyte-f4365717-e9c5-4af8-bf9a-ba4cc513e368" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] Acquiring lock "cinder-quobyte-bece9a02-5eab-4501-ad63-b21846c437b1" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] Acquiring lock "cinder-318a08aa-5433-46a2-840e-21fb6802812e-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] Lock "cinder-quobyte-bece9a02-5eab-4501-ad63-b21846c437b1" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] Deleting offline snapshot bece9a02-5eab-4501-ad63-b21846c437b1 of volume f4365717-e9c5-4af8-bf9a-ba4cc513e368 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] snapshot_file for this snap is: volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.bece9a02-5eab-4501-ad63-b21846c437b1 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] Lock "cinder-318a08aa-5433-46a2-840e-21fb6802812e-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d804a526-e66c-4cd6-a00a-1fd6d1b4eee6]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.bece9a02-5eab-4501-ad63-b21846c437b1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] Acquiring lock "cinder-quobyte-318a08aa-5433-46a2-840e-21fb6802812e" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] Lock "cinder-quobyte-318a08aa-5433-46a2-840e-21fb6802812e" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b8c3cd-94f2-4a58-b878-6036373652e1]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-318a08aa-5433-46a2-840e-21fb6802812e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:26 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.bece9a02-5eab-4501-ad63-b21846c437b1 Sep 01 12:18:26 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:26 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-318a08aa-5433-46a2-840e-21fb6802812e Sep 01 12:18:26 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:26 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.bece9a02-5eab-4501-ad63-b21846c437b1" returned: 0 in 0.438s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d140b1-9717-4a5b-88c1-5e5c2a2948be]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:18:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:27 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-318a08aa-5433-46a2-840e-21fb6802812e" returned: 0 in 0.500s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-318a08aa-5433-46a2-840e-21fb6802812e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:27 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368 Sep 01 12:18:27 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:27 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-318a08aa-5433-46a2-840e-21fb6802812e Sep 01 12:18:27 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:27 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-318a08aa-5433-46a2-840e-21fb6802812e" returned: 0 in 0.314s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:27 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] Lock "cinder-quobyte-318a08aa-5433-46a2-840e-21fb6802812e" released by "delete_volume" :: held 0.874s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368" returned: 0 in 0.464s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.bece9a02-5eab-4501-ad63-b21846c437b1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:27 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=146,cinder:SELECT=127,cinder:INSERT=42,cinder:DELETE=11 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:18:27 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.bece9a02-5eab-4501-ad63-b21846c437b1 Sep 01 12:18:27 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:27 devstack cinder-volume[87084]: WARNING cinder.quota [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1676778168 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1676778168, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:18:27 devstack cinder-volume[87084]: WARNING cinder.quota [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1676778168 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1676778168, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:18:27 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] Created reservations ['f32cd56c-40a6-4917-b11b-03b12184c89f', 'c5772684-a97e-4419-ba40-487d5bd5722f', '8c90c02a-9102-4a48-9a22-6ef27aa6a0ff', '26d7b1c4-1c29-4c1b-9ac2-faa616bfa809'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:18:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:18:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:18:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:27 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:18:27 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:27 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.340s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:27 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:18:27 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.bece9a02-5eab-4501-ad63-b21846c437b1" returned: 0 in 0.577s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.bece9a02-5eab-4501-ad63-b21846c437b1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:27 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] Deleted volume successfully. Sep 01 12:18:28 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.bece9a02-5eab-4501-ad63-b21846c437b1 Sep 01 12:18:28 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9c53daef-f83e-4068-9cb1-b505eee57179 tempest-VolumeTypesAccessTest-1859617084 None] Lock "cinder-318a08aa-5433-46a2-840e-21fb6802812e-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:28 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368.bece9a02-5eab-4501-ad63-b21846c437b1" returned: 0 in 0.367s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:28 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=120,cinder:UPDATE=142,cinder:DELETE=17,cinder:INSERT=50 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:18:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] Lock "cinder-quobyte-bece9a02-5eab-4501-ad63-b21846c437b1" released by "_delete_snapshot" :: held 2.023s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] Lock "cinder-quobyte-f4365717-e9c5-4af8-bf9a-ba4cc513e368" released by "delete_snapshot" :: held 2.071s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:28 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] Created reservations ['f76701b0-ff2e-455a-9379-bc2de43f06a8', 'c9475f77-dd31-47b1-9276-6851350daced', 'aaf0a9cc-9a6f-4c3b-86c3-b1b70ccaafcf', 'bfc22d25-45ff-40c4-9957-1318500014ca'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:18:28 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] Delete snapshot completed successfully. Sep 01 12:18:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-dca34695-06a8-4fba-9d53-6a876bd5d891 tempest-CinderUnicodeTest-1937926506 None] Lock "cinder-bece9a02-5eab-4501-ad63-b21846c437b1-delete_snapshot" released by "delete_snapshot" :: held 2.268s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:28 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-e28ff351-4862-4406-a989-8dc8600b0a4d req-66707ff7-afb4-4d60-89e6-451d43c07ea5 tempest-TestShelveInstance-1786574594 None] Terminate volume connection completed successfully. Sep 01 12:18:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-e28ff351-4862-4406-a989-8dc8600b0a4d req-66707ff7-afb4-4d60-89e6-451d43c07ea5 tempest-TestShelveInstance-1786574594 None] Deleting attachment 286c345e-4a01-4ccf-9d41-a950128770e4. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:18:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3bfc9e03-6f20-4014-9fba-47838b0c82ea tempest-CinderUnicodeTest-1937926506 None] Acquiring lock "cinder-f4365717-e9c5-4af8-bf9a-ba4cc513e368-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3bfc9e03-6f20-4014-9fba-47838b0c82ea tempest-CinderUnicodeTest-1937926506 None] Lock "cinder-f4365717-e9c5-4af8-bf9a-ba4cc513e368-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3bfc9e03-6f20-4014-9fba-47838b0c82ea tempest-CinderUnicodeTest-1937926506 None] Acquiring lock "cinder-quobyte-f4365717-e9c5-4af8-bf9a-ba4cc513e368" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3bfc9e03-6f20-4014-9fba-47838b0c82ea tempest-CinderUnicodeTest-1937926506 None] Lock "cinder-quobyte-f4365717-e9c5-4af8-bf9a-ba4cc513e368" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:29 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7b19b4-034d-4f31-af93-067aacd638f8]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:18:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3bfc9e03-6f20-4014-9fba-47838b0c82ea tempest-CinderUnicodeTest-1937926506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:29 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368 Sep 01 12:18:29 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:30 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3bfc9e03-6f20-4014-9fba-47838b0c82ea tempest-CinderUnicodeTest-1937926506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368" returned: 0 in 0.407s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3bfc9e03-6f20-4014-9fba-47838b0c82ea tempest-CinderUnicodeTest-1937926506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:30 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368 Sep 01 12:18:30 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:30 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3bfc9e03-6f20-4014-9fba-47838b0c82ea tempest-CinderUnicodeTest-1937926506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f4365717-e9c5-4af8-bf9a-ba4cc513e368" returned: 0 in 0.290s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3bfc9e03-6f20-4014-9fba-47838b0c82ea tempest-CinderUnicodeTest-1937926506 None] Lock "cinder-quobyte-f4365717-e9c5-4af8-bf9a-ba4cc513e368" released by "delete_volume" :: held 0.768s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:30 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-3bfc9e03-6f20-4014-9fba-47838b0c82ea tempest-CinderUnicodeTest-1937926506 None] Created reservations ['9580926c-2313-4266-ad8e-3a5c16bc0a9e', 'e69903c1-3716-4f4f-afc4-29c4df9133af', '4a648dc7-e8c0-4d92-9398-cc042a8e8a36', 'c6dc235d-ec80-4fae-b48a-982ac4a523ca'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:18:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3bfc9e03-6f20-4014-9fba-47838b0c82ea tempest-CinderUnicodeTest-1937926506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3bfc9e03-6f20-4014-9fba-47838b0c82ea tempest-CinderUnicodeTest-1937926506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3bfc9e03-6f20-4014-9fba-47838b0c82ea tempest-CinderUnicodeTest-1937926506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:18:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3bfc9e03-6f20-4014-9fba-47838b0c82ea tempest-CinderUnicodeTest-1937926506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:18:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3bfc9e03-6f20-4014-9fba-47838b0c82ea tempest-CinderUnicodeTest-1937926506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3bfc9e03-6f20-4014-9fba-47838b0c82ea tempest-CinderUnicodeTest-1937926506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:30 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:18:30 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9d4e49be-3f37-4999-b57d-d320fe0fbe2f tempest-CinderUnicodeTest-1937926506 None] Acquiring lock "cinder-241f7949-fe12-4494-86e1-e5ed706bda3d-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9d4e49be-3f37-4999-b57d-d320fe0fbe2f tempest-CinderUnicodeTest-1937926506 None] Lock "cinder-241f7949-fe12-4494-86e1-e5ed706bda3d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9d4e49be-3f37-4999-b57d-d320fe0fbe2f tempest-CinderUnicodeTest-1937926506 None] Acquiring lock "cinder-quobyte-241f7949-fe12-4494-86e1-e5ed706bda3d" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9d4e49be-3f37-4999-b57d-d320fe0fbe2f tempest-CinderUnicodeTest-1937926506 None] Lock "cinder-quobyte-241f7949-fe12-4494-86e1-e5ed706bda3d" acquired by "delete_volume" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[10074d62-b1b1-4a07-960f-50e44ca61ad1]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d4e49be-3f37-4999-b57d-d320fe0fbe2f tempest-CinderUnicodeTest-1937926506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-241f7949-fe12-4494-86e1-e5ed706bda3d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:31 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3bfc9e03-6f20-4014-9fba-47838b0c82ea tempest-CinderUnicodeTest-1937926506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.411s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-3bfc9e03-6f20-4014-9fba-47838b0c82ea tempest-CinderUnicodeTest-1937926506 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:18:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3bfc9e03-6f20-4014-9fba-47838b0c82ea tempest-CinderUnicodeTest-1937926506 None] Deleted volume successfully. Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-3bfc9e03-6f20-4014-9fba-47838b0c82ea tempest-CinderUnicodeTest-1937926506 None] Lock "cinder-f4365717-e9c5-4af8-bf9a-ba4cc513e368-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:31 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-241f7949-fe12-4494-86e1-e5ed706bda3d Sep 01 12:18:31 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:31 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d4e49be-3f37-4999-b57d-d320fe0fbe2f tempest-CinderUnicodeTest-1937926506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-241f7949-fe12-4494-86e1-e5ed706bda3d" returned: 0 in 0.474s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d4e49be-3f37-4999-b57d-d320fe0fbe2f tempest-CinderUnicodeTest-1937926506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-241f7949-fe12-4494-86e1-e5ed706bda3d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:31 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-241f7949-fe12-4494-86e1-e5ed706bda3d Sep 01 12:18:31 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-ff766c21-7119-4e9c-b834-0a2f4edb64af req-c1b5e3e7-3cb0-4d3f-9d25-1c9d116c9f17 tempest-TestShelveInstance-1786574594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-ff766c21-7119-4e9c-b834-0a2f4edb64af req-c1b5e3e7-3cb0-4d3f-9d25-1c9d116c9f17 tempest-TestShelveInstance-1786574594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-ff766c21-7119-4e9c-b834-0a2f4edb64af req-c1b5e3e7-3cb0-4d3f-9d25-1c9d116c9f17 tempest-TestShelveInstance-1786574594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-ff766c21-7119-4e9c-b834-0a2f4edb64af req-c1b5e3e7-3cb0-4d3f-9d25-1c9d116c9f17 tempest-TestShelveInstance-1786574594 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52d2beaf-b701-4304-ad20-307963684e99', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:18:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-ff766c21-7119-4e9c-b834-0a2f4edb64af req-c1b5e3e7-3cb0-4d3f-9d25-1c9d116c9f17 tempest-TestShelveInstance-1786574594 None] attachment_update completed successfully. Sep 01 12:18:31 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d4e49be-3f37-4999-b57d-d320fe0fbe2f tempest-CinderUnicodeTest-1937926506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-241f7949-fe12-4494-86e1-e5ed706bda3d" returned: 0 in 0.278s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9d4e49be-3f37-4999-b57d-d320fe0fbe2f tempest-CinderUnicodeTest-1937926506 None] Lock "cinder-quobyte-241f7949-fe12-4494-86e1-e5ed706bda3d" released by "delete_volume" :: held 0.819s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-9d4e49be-3f37-4999-b57d-d320fe0fbe2f tempest-CinderUnicodeTest-1937926506 None] Created reservations ['6e07dea6-a83d-4c72-8c9c-a5e953b11398', '77f66b2c-e99d-4d15-916f-52e78a297e3b', 'fc796950-5dd5-4bec-aeed-84ee86f427e7', '4bf0a897-fb5e-43a9-9717-452ab105d2d6'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9d4e49be-3f37-4999-b57d-d320fe0fbe2f tempest-CinderUnicodeTest-1937926506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9d4e49be-3f37-4999-b57d-d320fe0fbe2f tempest-CinderUnicodeTest-1937926506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9d4e49be-3f37-4999-b57d-d320fe0fbe2f tempest-CinderUnicodeTest-1937926506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9d4e49be-3f37-4999-b57d-d320fe0fbe2f tempest-CinderUnicodeTest-1937926506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9d4e49be-3f37-4999-b57d-d320fe0fbe2f tempest-CinderUnicodeTest-1937926506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d4e49be-3f37-4999-b57d-d320fe0fbe2f tempest-CinderUnicodeTest-1937926506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:32 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:18:32 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:32 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d4e49be-3f37-4999-b57d-d320fe0fbe2f tempest-CinderUnicodeTest-1937926506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.390s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:32 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-9d4e49be-3f37-4999-b57d-d320fe0fbe2f tempest-CinderUnicodeTest-1937926506 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:18:32 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9d4e49be-3f37-4999-b57d-d320fe0fbe2f tempest-CinderUnicodeTest-1937926506 None] Deleted volume successfully. Sep 01 12:18:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9d4e49be-3f37-4999-b57d-d320fe0fbe2f tempest-CinderUnicodeTest-1937926506 None] Lock "cinder-241f7949-fe12-4494-86e1-e5ed706bda3d-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-d3dfcdab-f840-470e-a1a7-ca8bc101109e req-7a00867f-00dd-49ef-8d6d-046d63462e94 tempest-TestInstancesWithCinderVolumes-1035486613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-d3dfcdab-f840-470e-a1a7-ca8bc101109e req-7a00867f-00dd-49ef-8d6d-046d63462e94 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-d3dfcdab-f840-470e-a1a7-ca8bc101109e req-7a00867f-00dd-49ef-8d6d-046d63462e94 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-d3dfcdab-f840-470e-a1a7-ca8bc101109e req-7a00867f-00dd-49ef-8d6d-046d63462e94 tempest-TestInstancesWithCinderVolumes-1035486613 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-35a522ab-8735-4d71-bd64-da0204c19aff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a39a98f-4b75-49b3-9bcb-373564e2da24', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:18:35 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-d3dfcdab-f840-470e-a1a7-ca8bc101109e req-7a00867f-00dd-49ef-8d6d-046d63462e94 tempest-TestInstancesWithCinderVolumes-1035486613 None] attachment_update completed successfully. Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Flow 'volume_create_manager' (4d95823b-1881-49d7-bed4-a28fba12e9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8469b2-f817-4647-9141-eefb6d2c01c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8469b2-f817-4647-9141-eefb6d2c01c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-668391326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9ba19d136847bb86d0b620b0b3352d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:18:38Z,use_quota=True,user_id='d83ec013457b4c15a6e9dbb5c49915be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d51f954-baba-44d6-8dc9-f32b372211ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d51f954-baba-44d6-8dc9-f32b372211ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df4f2e2-9cf2-454a-9101-a85cfa14764b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df4f2e2-9cf2-454a-9101-a85cfa14764b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd', 'volume_name': 'volume-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcfededb-b519-472a-8f06-c914d806e343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcfededb-b519-472a-8f06-c914d806e343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56fe458-3b90-4e85-b685-832b0b067322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:38 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Volume e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd', 'volume_size': 1} Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-668391326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9ba19d136847bb86d0b620b0b3352d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:18:38Z,use_quota=True,user_id='d83ec013457b4c15a6e9dbb5c49915be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Creating volume e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:18:38 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:38 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd 1073741824 Sep 01 12:18:38 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-177f179a-4488-4b54-9e5b-7ee06aa06bb2 req-0b91428e-84c2-4c8e-902a-9d946ebf1617 tempest-TestInstancesWithCinderVolumes-1035486613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:39 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd 1073741824" returned: 0 in 0.647s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:39 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd Sep 01 12:18:39 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:39 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd" returned: 0 in 0.296s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:18:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-177f179a-4488-4b54-9e5b-7ee06aa06bb2 req-0b91428e-84c2-4c8e-902a-9d946ebf1617 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.774s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56fe458-3b90-4e85-b685-832b0b067322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ccb592-381e-4593-8b2b-78301cd2f9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-177f179a-4488-4b54-9e5b-7ee06aa06bb2 req-0b91428e-84c2-4c8e-902a-9d946ebf1617 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Volume volume-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd (e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd): created successfully Sep 01 12:18:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ccb592-381e-4593-8b2b-78301cd2f9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Flow 'volume_create_manager' (4d95823b-1881-49d7-bed4-a28fba12e9e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:18:39 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-590dd3ec-bd60-46f1-8c7d-10688db3cc76 tempest-ProjectReaderTests-287135173 None] Created volume successfully. Sep 01 12:18:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-177f179a-4488-4b54-9e5b-7ee06aa06bb2 req-0b91428e-84c2-4c8e-902a-9d946ebf1617 tempest-TestInstancesWithCinderVolumes-1035486613 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-349a9c42-40c3-4789-827a-b6d8d81cb3b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '476c1ccc-64e8-475c-9a44-3bb25bc4a54c', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:18:39 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-177f179a-4488-4b54-9e5b-7ee06aa06bb2 req-0b91428e-84c2-4c8e-902a-9d946ebf1617 tempest-TestInstancesWithCinderVolumes-1035486613 None] attachment_update completed successfully. Sep 01 12:18:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-abef7acb-b708-42e6-9f20-0fece05e69b9 tempest-ProjectReaderTests-287135173 None] Acquiring lock "cinder-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-abef7acb-b708-42e6-9f20-0fece05e69b9 tempest-ProjectReaderTests-287135173 None] Lock "cinder-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-abef7acb-b708-42e6-9f20-0fece05e69b9 tempest-ProjectReaderTests-287135173 None] Acquiring lock "cinder-quobyte-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-abef7acb-b708-42e6-9f20-0fece05e69b9 tempest-ProjectReaderTests-287135173 None] Lock "cinder-quobyte-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:41 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dec3fa-bff5-4303-961c-29315871aa18]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:18:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abef7acb-b708-42e6-9f20-0fece05e69b9 tempest-ProjectReaderTests-287135173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:41 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd Sep 01 12:18:41 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:18:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:18:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:18:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:41 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abef7acb-b708-42e6-9f20-0fece05e69b9 tempest-ProjectReaderTests-287135173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd" returned: 0 in 0.624s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abef7acb-b708-42e6-9f20-0fece05e69b9 tempest-ProjectReaderTests-287135173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:41 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:18:41 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:41 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd Sep 01 12:18:41 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:42 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abef7acb-b708-42e6-9f20-0fece05e69b9 tempest-ProjectReaderTests-287135173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd" returned: 0 in 0.394s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-abef7acb-b708-42e6-9f20-0fece05e69b9 tempest-ProjectReaderTests-287135173 None] Lock "cinder-quobyte-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd" released by "delete_volume" :: held 1.103s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:42 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.560s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:18:42 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:18:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:18:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:18:42 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-abef7acb-b708-42e6-9f20-0fece05e69b9 tempest-ProjectReaderTests-287135173 None] Created reservations ['800974ed-08bd-4488-bc6a-f5025b202a2a', '4824883a-a286-406a-96a1-cabd32581323', '23892140-1cfc-4e65-bc57-03af69a9153a', '91e41033-cf94-4d90-a800-7a66cecd3a9e'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:18:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-abef7acb-b708-42e6-9f20-0fece05e69b9 tempest-ProjectReaderTests-287135173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-abef7acb-b708-42e6-9f20-0fece05e69b9 tempest-ProjectReaderTests-287135173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-abef7acb-b708-42e6-9f20-0fece05e69b9 tempest-ProjectReaderTests-287135173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:18:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-abef7acb-b708-42e6-9f20-0fece05e69b9 tempest-ProjectReaderTests-287135173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:18:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-abef7acb-b708-42e6-9f20-0fece05e69b9 tempest-ProjectReaderTests-287135173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abef7acb-b708-42e6-9f20-0fece05e69b9 tempest-ProjectReaderTests-287135173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:42 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:18:42 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:42 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abef7acb-b708-42e6-9f20-0fece05e69b9 tempest-ProjectReaderTests-287135173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.316s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-abef7acb-b708-42e6-9f20-0fece05e69b9 tempest-ProjectReaderTests-287135173 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:18:42 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-abef7acb-b708-42e6-9f20-0fece05e69b9 tempest-ProjectReaderTests-287135173 None] Deleted volume successfully. Sep 01 12:18:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-abef7acb-b708-42e6-9f20-0fece05e69b9 tempest-ProjectReaderTests-287135173 None] Lock "cinder-e065a97b-c3c4-4d0e-9e1a-2bd919ec40fd-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Flow 'volume_create_manager' (0ec662b0-aa9c-4019-979a-f9b96331bf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777174f1-efc5-4b2d-b19e-3bbd467e80a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777174f1-efc5-4b2d-b19e-3bbd467e80a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-890717323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f796b6d-fb46-4200-b1f6-67bdf8487858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9ba19d136847bb86d0b620b0b3352d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:18:44Z,use_quota=True,user_id='d83ec013457b4c15a6e9dbb5c49915be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (531d25d1-46ea-42f2-95de-caa2d052182a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (531d25d1-46ea-42f2-95de-caa2d052182a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b49167e-b969-405c-b634-e4201b184688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b49167e-b969-405c-b634-e4201b184688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f796b6d-fb46-4200-b1f6-67bdf8487858', 'volume_name': 'volume-4f796b6d-fb46-4200-b1f6-67bdf8487858', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78bf3e5-c9b5-487e-9f96-b89accc83dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78bf3e5-c9b5-487e-9f96-b89accc83dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552846b4-de35-4456-889c-b8f065a0db1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:44 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Volume 4f796b6d-fb46-4200-b1f6-67bdf8487858: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f796b6d-fb46-4200-b1f6-67bdf8487858', 'volume_size': 1} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-890717323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f796b6d-fb46-4200-b1f6-67bdf8487858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9ba19d136847bb86d0b620b0b3352d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:18:44Z,use_quota=True,user_id='d83ec013457b4c15a6e9dbb5c49915be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Creating volume 4f796b6d-fb46-4200-b1f6-67bdf8487858 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:18:44 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4f796b6d-fb46-4200-b1f6-67bdf8487858 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:44 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4f796b6d-fb46-4200-b1f6-67bdf8487858 1073741824 Sep 01 12:18:44 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:44 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4f796b6d-fb46-4200-b1f6-67bdf8487858 1073741824" returned: 0 in 0.545s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4f796b6d-fb46-4200-b1f6-67bdf8487858 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:44 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4f796b6d-fb46-4200-b1f6-67bdf8487858 Sep 01 12:18:44 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:45 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4f796b6d-fb46-4200-b1f6-67bdf8487858" returned: 0 in 0.309s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:18:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552846b4-de35-4456-889c-b8f065a0db1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f796b6d-fb46-4200-b1f6-67bdf8487858', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0db1c4-02b4-4a73-b70c-d6e50ae25cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:45 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Volume volume-4f796b6d-fb46-4200-b1f6-67bdf8487858 (4f796b6d-fb46-4200-b1f6-67bdf8487858): created successfully Sep 01 12:18:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0db1c4-02b4-4a73-b70c-d6e50ae25cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Flow 'volume_create_manager' (0ec662b0-aa9c-4019-979a-f9b96331bf31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:18:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c5ddc56e-52cf-461b-94a0-e3cd99c9fb3e tempest-ProjectReaderTests-287135173 None] Created volume successfully. Sep 01 12:18:46 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-8940241a-122e-41aa-a7d9-fd6b08abcc9a req-4e20d956-e4fb-4b36-9f46-ca997e420797 tempest-TestInstancesWithCinderVolumes-1035486613 None] Terminate volume connection completed successfully. Sep 01 12:18:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-8940241a-122e-41aa-a7d9-fd6b08abcc9a req-4e20d956-e4fb-4b36-9f46-ca997e420797 tempest-TestInstancesWithCinderVolumes-1035486613 None] Deleting attachment 8a39a98f-4b75-49b3-9bcb-373564e2da24. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:18:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a0549b39-b8fd-4393-bcb2-1bc7c3405344 tempest-ProjectReaderTests-287135173 None] Acquiring lock "cinder-4f796b6d-fb46-4200-b1f6-67bdf8487858-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a0549b39-b8fd-4393-bcb2-1bc7c3405344 tempest-ProjectReaderTests-287135173 None] Lock "cinder-4f796b6d-fb46-4200-b1f6-67bdf8487858-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a0549b39-b8fd-4393-bcb2-1bc7c3405344 tempest-ProjectReaderTests-287135173 None] Acquiring lock "cinder-quobyte-4f796b6d-fb46-4200-b1f6-67bdf8487858" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a0549b39-b8fd-4393-bcb2-1bc7c3405344 tempest-ProjectReaderTests-287135173 None] Lock "cinder-quobyte-4f796b6d-fb46-4200-b1f6-67bdf8487858" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:46 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[136b299a-8f5a-437f-a0ee-76b026daf1e3]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:18:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a0549b39-b8fd-4393-bcb2-1bc7c3405344 tempest-ProjectReaderTests-287135173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4f796b6d-fb46-4200-b1f6-67bdf8487858 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:46 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4f796b6d-fb46-4200-b1f6-67bdf8487858 Sep 01 12:18:46 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] Acquiring lock "cinder-35a522ab-8735-4d71-bd64-da0204c19aff-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "cinder-35a522ab-8735-4d71-bd64-da0204c19aff-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] Acquiring lock "cinder-quobyte-35a522ab-8735-4d71-bd64-da0204c19aff" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "cinder-quobyte-35a522ab-8735-4d71-bd64-da0204c19aff" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:46 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b994d2c-fc9a-461e-bb8e-153a164043aa]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:18:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-35a522ab-8735-4d71-bd64-da0204c19aff {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:46 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a0549b39-b8fd-4393-bcb2-1bc7c3405344 tempest-ProjectReaderTests-287135173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4f796b6d-fb46-4200-b1f6-67bdf8487858" returned: 0 in 0.512s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a0549b39-b8fd-4393-bcb2-1bc7c3405344 tempest-ProjectReaderTests-287135173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4f796b6d-fb46-4200-b1f6-67bdf8487858 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:46 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4f796b6d-fb46-4200-b1f6-67bdf8487858 Sep 01 12:18:47 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:47 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-35a522ab-8735-4d71-bd64-da0204c19aff Sep 01 12:18:47 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:47 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a0549b39-b8fd-4393-bcb2-1bc7c3405344 tempest-ProjectReaderTests-287135173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4f796b6d-fb46-4200-b1f6-67bdf8487858" returned: 0 in 0.428s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a0549b39-b8fd-4393-bcb2-1bc7c3405344 tempest-ProjectReaderTests-287135173 None] Lock "cinder-quobyte-4f796b6d-fb46-4200-b1f6-67bdf8487858" released by "delete_volume" :: held 0.991s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:47 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-35a522ab-8735-4d71-bd64-da0204c19aff" returned: 0 in 0.591s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-35a522ab-8735-4d71-bd64-da0204c19aff {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:47 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a0549b39-b8fd-4393-bcb2-1bc7c3405344 tempest-ProjectReaderTests-287135173 None] Created reservations ['a0d8323d-5bda-46c4-8569-97c7ff33b4cc', 'bd4e7583-bdaf-4eee-a269-8756ba33d406', '70cee7b7-d34f-4cc7-b49b-bad3ac0807ce', '804aa722-adf0-4e6e-b8eb-84c7023a885c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:18:47 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-35a522ab-8735-4d71-bd64-da0204c19aff Sep 01 12:18:47 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a0549b39-b8fd-4393-bcb2-1bc7c3405344 tempest-ProjectReaderTests-287135173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a0549b39-b8fd-4393-bcb2-1bc7c3405344 tempest-ProjectReaderTests-287135173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a0549b39-b8fd-4393-bcb2-1bc7c3405344 tempest-ProjectReaderTests-287135173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:18:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a0549b39-b8fd-4393-bcb2-1bc7c3405344 tempest-ProjectReaderTests-287135173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:18:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a0549b39-b8fd-4393-bcb2-1bc7c3405344 tempest-ProjectReaderTests-287135173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a0549b39-b8fd-4393-bcb2-1bc7c3405344 tempest-ProjectReaderTests-287135173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:47 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:18:47 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:47 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-35a522ab-8735-4d71-bd64-da0204c19aff" returned: 0 in 0.457s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "cinder-quobyte-35a522ab-8735-4d71-bd64-da0204c19aff" released by "delete_volume" :: held 1.129s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:48 devstack cinder-volume[87084]: WARNING cinder.quota [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2033691439-1598336007 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2033691439-1598336007, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:18:48 devstack cinder-volume[87084]: WARNING cinder.quota [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2033691439-1598336007 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2033691439-1598336007, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:18:48 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a0549b39-b8fd-4393-bcb2-1bc7c3405344 tempest-ProjectReaderTests-287135173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.397s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:48 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-a0549b39-b8fd-4393-bcb2-1bc7c3405344 tempest-ProjectReaderTests-287135173 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:18:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a0549b39-b8fd-4393-bcb2-1bc7c3405344 tempest-ProjectReaderTests-287135173 None] Deleted volume successfully. Sep 01 12:18:48 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] Created reservations ['330480bb-6df7-487c-b225-e4d05031c4a3', '742107b7-e630-4e3f-a0cc-08f23f7fe317', 'f9a3ec2d-a773-4022-bc01-1989bf0ef7d2', 'ac35067c-b28e-402a-b5fb-0bb52d38842c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:18:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a0549b39-b8fd-4393-bcb2-1bc7c3405344 tempest-ProjectReaderTests-287135173 None] Lock "cinder-4f796b6d-fb46-4200-b1f6-67bdf8487858-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:18:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:18:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:48 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:18:48 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:48 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.397s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:48 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:18:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] Deleted volume successfully. Sep 01 12:18:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8fdcb240-5736-4c1f-b637-95e50459847c tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "cinder-35a522ab-8735-4d71-bd64-da0204c19aff-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:51 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-39d16040-8a0e-47d8-a224-3dfa4ee63eb0 req-40abe9b8-7df7-4f18-b0de-240bf1d548dc tempest-TestInstancesWithCinderVolumes-1035486613 None] Terminate volume connection completed successfully. Sep 01 12:18:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-39d16040-8a0e-47d8-a224-3dfa4ee63eb0 req-40abe9b8-7df7-4f18-b0de-240bf1d548dc tempest-TestInstancesWithCinderVolumes-1035486613 None] Deleting attachment 476c1ccc-64e8-475c-9a44-3bb25bc4a54c. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:18:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] Acquiring lock "cinder-349a9c42-40c3-4789-827a-b6d8d81cb3b3-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "cinder-349a9c42-40c3-4789-827a-b6d8d81cb3b3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] Acquiring lock "cinder-quobyte-349a9c42-40c3-4789-827a-b6d8d81cb3b3" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "cinder-quobyte-349a9c42-40c3-4789-827a-b6d8d81cb3b3" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:52 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[65573d83-91fd-4783-9a45-600627fc5190]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:18:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-349a9c42-40c3-4789-827a-b6d8d81cb3b3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:52 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-349a9c42-40c3-4789-827a-b6d8d81cb3b3 Sep 01 12:18:52 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:53 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-349a9c42-40c3-4789-827a-b6d8d81cb3b3" returned: 0 in 0.532s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-349a9c42-40c3-4789-827a-b6d8d81cb3b3 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:53 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-349a9c42-40c3-4789-827a-b6d8d81cb3b3 Sep 01 12:18:53 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:53 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-349a9c42-40c3-4789-827a-b6d8d81cb3b3" returned: 0 in 0.331s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "cinder-quobyte-349a9c42-40c3-4789-827a-b6d8d81cb3b3" released by "delete_volume" :: held 0.923s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:53 devstack cinder-volume[87084]: WARNING cinder.quota [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1770873245-657216650 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1770873245-657216650, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:18:53 devstack cinder-volume[87084]: WARNING cinder.quota [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1770873245-657216650 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1770873245-657216650, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] Created reservations ['15bccec2-6c70-4e7c-b393-0f04010a914b', '79eb7d71-d047-4cf7-9e33-f7f0cce99ad2', 'b6182be3-7bfb-4c3f-9f1b-fbd899d5a70e', '18aa7bf2-5145-4a4e-a751-07d31e601c73'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:53 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:18:53 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Flow 'volume_create_manager' (c74493b4-e7f2-448b-bc6f-ee506480d8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b9546a9-5214-4a67-852d-13a72a75cce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b9546a9-5214-4a67-852d-13a72a75cce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1298480862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85dade5-2cc6-4a62-87e1-6563a5481f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ce0b6630b44cbdbb5bcaf7b27edb2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:18:54Z,use_quota=True,user_id='61b0eb8d18b647cbb606f8696ce894d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22002ae3-7880-4187-98d4-9e9bc2e4cc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22002ae3-7880-4187-98d4-9e9bc2e4cc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a4aad0-cbbe-4f03-bda8-9c47448d56d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a4aad0-cbbe-4f03-bda8-9c47448d56d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f85dade5-2cc6-4a62-87e1-6563a5481f43', 'volume_name': 'volume-f85dade5-2cc6-4a62-87e1-6563a5481f43', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac89d7f8-6298-42de-b6a3-dc8b23d6dcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac89d7f8-6298-42de-b6a3-dc8b23d6dcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c52cb55-145b-4c97-bf43-7173e0cd05a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:53 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Volume f85dade5-2cc6-4a62-87e1-6563a5481f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f85dade5-2cc6-4a62-87e1-6563a5481f43', 'volume_size': 1} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1298480862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85dade5-2cc6-4a62-87e1-6563a5481f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ce0b6630b44cbdbb5bcaf7b27edb2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:18:54Z,use_quota=True,user_id='61b0eb8d18b647cbb606f8696ce894d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Creating volume f85dade5-2cc6-4a62-87e1-6563a5481f43 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:18:53 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:18:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f85dade5-2cc6-4a62-87e1-6563a5481f43 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:54 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f85dade5-2cc6-4a62-87e1-6563a5481f43 1073741824 Sep 01 12:18:54 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:54 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.487s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:54 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:18:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] Deleted volume successfully. Sep 01 12:18:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-20a21c09-af87-4cc9-bfbf-72b6b9e17b61 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "cinder-349a9c42-40c3-4789-827a-b6d8d81cb3b3-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:54 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f85dade5-2cc6-4a62-87e1-6563a5481f43 1073741824" returned: 0 in 0.625s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f85dade5-2cc6-4a62-87e1-6563a5481f43 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:54 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f85dade5-2cc6-4a62-87e1-6563a5481f43 Sep 01 12:18:54 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:54 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f85dade5-2cc6-4a62-87e1-6563a5481f43" returned: 0 in 0.320s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:18:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c52cb55-145b-4c97-bf43-7173e0cd05a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f85dade5-2cc6-4a62-87e1-6563a5481f43', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46442e2-c801-439c-bfdc-b01dbe909e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:55 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Volume volume-f85dade5-2cc6-4a62-87e1-6563a5481f43 (f85dade5-2cc6-4a62-87e1-6563a5481f43): created successfully Sep 01 12:18:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46442e2-c801-439c-bfdc-b01dbe909e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Flow 'volume_create_manager' (c74493b4-e7f2-448b-bc6f-ee506480d8f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:18:55 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-25170716-77e9-44dc-9c50-f7fc7131650a tempest-VolumesListAdminTestJSON-601449589 None] Created volume successfully. Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Flow 'volume_create_manager' (1996eb5d-e3bd-44e0-b4c8-60d5a219ef78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32442420-cfba-4dc8-bbc3-57c4e25667ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32442420-cfba-4dc8-bbc3-57c4e25667ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-911522311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c687dac4-116b-4419-b99b-1e770b46e2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ce0b6630b44cbdbb5bcaf7b27edb2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:18:57Z,use_quota=True,user_id='61b0eb8d18b647cbb606f8696ce894d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10870f4c-777b-4dd2-908c-7d37b8bcd2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10870f4c-777b-4dd2-908c-7d37b8bcd2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6b1662-717a-4d90-8f30-5bdf64fb8ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6b1662-717a-4d90-8f30-5bdf64fb8ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c687dac4-116b-4419-b99b-1e770b46e2cd', 'volume_name': 'volume-c687dac4-116b-4419-b99b-1e770b46e2cd', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518cddbe-2100-4c8a-bc96-c9395c1da18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518cddbe-2100-4c8a-bc96-c9395c1da18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3777c355-a794-4189-8016-021a34c4ffc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:56 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Volume c687dac4-116b-4419-b99b-1e770b46e2cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c687dac4-116b-4419-b99b-1e770b46e2cd', 'volume_size': 1} Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-911522311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c687dac4-116b-4419-b99b-1e770b46e2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ce0b6630b44cbdbb5bcaf7b27edb2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:18:57Z,use_quota=True,user_id='61b0eb8d18b647cbb606f8696ce894d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Creating volume c687dac4-116b-4419-b99b-1e770b46e2cd {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:18:56 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:18:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c687dac4-116b-4419-b99b-1e770b46e2cd 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:56 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c687dac4-116b-4419-b99b-1e770b46e2cd 1073741824 Sep 01 12:18:56 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-5ee3b5b4-f5ef-4688-9ea4-5e7d97f6ac24 req-de126286-85b3-4709-a0ac-5fd77002b8d6 tempest-TestInstancesWithCinderVolumes-1035486613 None] Terminate volume connection completed successfully. Sep 01 12:18:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-5ee3b5b4-f5ef-4688-9ea4-5e7d97f6ac24 req-de126286-85b3-4709-a0ac-5fd77002b8d6 tempest-TestInstancesWithCinderVolumes-1035486613 None] Deleting attachment c6b24771-edd4-4d09-96cb-ddf4b73347ee. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:18:57 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c687dac4-116b-4419-b99b-1e770b46e2cd 1073741824" returned: 0 in 0.546s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c687dac4-116b-4419-b99b-1e770b46e2cd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:57 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c687dac4-116b-4419-b99b-1e770b46e2cd Sep 01 12:18:57 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:57 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c687dac4-116b-4419-b99b-1e770b46e2cd" returned: 0 in 0.267s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:18:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3777c355-a794-4189-8016-021a34c4ffc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c687dac4-116b-4419-b99b-1e770b46e2cd', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f1caaa-62e5-448e-ace4-ee7b780ef6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:57 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Volume volume-c687dac4-116b-4419-b99b-1e770b46e2cd (c687dac4-116b-4419-b99b-1e770b46e2cd): created successfully Sep 01 12:18:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f1caaa-62e5-448e-ace4-ee7b780ef6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Flow 'volume_create_manager' (1996eb5d-e3bd-44e0-b4c8-60d5a219ef78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:18:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-cf74b61d-38f3-4bbe-8b3b-3662d7eb770b tempest-VolumesListAdminTestJSON-601449589 None] Created volume successfully. Sep 01 12:18:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] Acquiring lock "cinder-71968bae-fbd6-4c72-b636-5c907e1f8aa5-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "cinder-71968bae-fbd6-4c72-b636-5c907e1f8aa5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] Acquiring lock "cinder-quobyte-71968bae-fbd6-4c72-b636-5c907e1f8aa5" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:18:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "cinder-quobyte-71968bae-fbd6-4c72-b636-5c907e1f8aa5" acquired by "delete_volume" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:18:58 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dcd177-3907-4f84-b021-4cc796bce870]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:18:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:58 devstack sudo[101702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5 Sep 01 12:18:58 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:58 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5" returned: 0 in 0.352s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:58 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5 Sep 01 12:18:58 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:58 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-71968bae-fbd6-4c72-b636-5c907e1f8aa5" returned: 0 in 0.269s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "cinder-quobyte-71968bae-fbd6-4c72-b636-5c907e1f8aa5" released by "delete_volume" :: held 0.658s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:58 devstack cinder-volume[87084]: WARNING cinder.quota [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-387904493-378850150 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-387904493-378850150, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:18:58 devstack cinder-volume[87084]: WARNING cinder.quota [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-387904493-378850150 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-387904493-378850150, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:18:58 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] Created reservations ['4cb2d5ce-cdc2-47a0-85a5-edd829d487a0', 'cda729ea-e2e1-4b69-9101-eaa92631a1a2', 'ef1f6b00-4fa9-4155-9e5d-5483244225ad', 'b2a8aa7d-08d2-4f68-b35c-4edf3a2a9688'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:18:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:18:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:18:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:58 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:18:58 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:59 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.272s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:18:59 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] Deleted volume successfully. Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Flow 'volume_create_manager' (f7380492-940d-4eb5-8808-50d5b53516b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e735d1b6-8842-4d8d-ac9d-2136a8e4ee4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e735d1b6-8842-4d8d-ac9d-2136a8e4ee4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-780935872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c1f177-9c99-4c74-aa80-6fbfbe05bedb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ce0b6630b44cbdbb5bcaf7b27edb2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:18:59Z,use_quota=True,user_id='61b0eb8d18b647cbb606f8696ce894d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435caabc-c5f3-4f98-92c2-a931e7b9159b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435caabc-c5f3-4f98-92c2-a931e7b9159b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33582b11-c27a-4c4a-884d-6566cb08bd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33582b11-c27a-4c4a-884d-6566cb08bd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46c1f177-9c99-4c74-aa80-6fbfbe05bedb', 'volume_name': 'volume-46c1f177-9c99-4c74-aa80-6fbfbe05bedb', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d70ed8-8010-42f3-8331-899d133b03f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d70ed8-8010-42f3-8331-899d133b03f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b535a0ce-cee6-4a1e-8d12-bc91771686b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:18:59 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Volume 46c1f177-9c99-4c74-aa80-6fbfbe05bedb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46c1f177-9c99-4c74-aa80-6fbfbe05bedb', 'volume_size': 1} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-780935872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c1f177-9c99-4c74-aa80-6fbfbe05bedb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ce0b6630b44cbdbb5bcaf7b27edb2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:18:59Z,use_quota=True,user_id='61b0eb8d18b647cbb606f8696ce894d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Creating volume 46c1f177-9c99-4c74-aa80-6fbfbe05bedb {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:18:59 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-46c1f177-9c99-4c74-aa80-6fbfbe05bedb 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-395ce83d-b378-4dd5-bc0e-979b34ff0cb5 tempest-TestInstancesWithCinderVolumes-1035486613 None] Lock "cinder-71968bae-fbd6-4c72-b636-5c907e1f8aa5-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:18:59 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-46c1f177-9c99-4c74-aa80-6fbfbe05bedb 1073741824 Sep 01 12:18:59 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:18:59 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-46c1f177-9c99-4c74-aa80-6fbfbe05bedb 1073741824" returned: 0 in 0.477s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:18:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-46c1f177-9c99-4c74-aa80-6fbfbe05bedb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:18:59 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-46c1f177-9c99-4c74-aa80-6fbfbe05bedb Sep 01 12:18:59 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:00 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-46c1f177-9c99-4c74-aa80-6fbfbe05bedb" returned: 0 in 0.272s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:19:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b535a0ce-cee6-4a1e-8d12-bc91771686b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46c1f177-9c99-4c74-aa80-6fbfbe05bedb', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7f7606-7d3f-43ae-8ad3-63b92831eab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:00 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Volume volume-46c1f177-9c99-4c74-aa80-6fbfbe05bedb (46c1f177-9c99-4c74-aa80-6fbfbe05bedb): created successfully Sep 01 12:19:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7f7606-7d3f-43ae-8ad3-63b92831eab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Flow 'volume_create_manager' (f7380492-940d-4eb5-8808-50d5b53516b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:00 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5c577056-b5da-4836-aadf-4bb13438b34a tempest-VolumesListAdminTestJSON-601449589 None] Created volume successfully. Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Flow 'volume_create_manager' (00dc417c-933b-490b-b429-31065bee82ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dea49dd-9398-4a8d-a7dd-d08741e23167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dea49dd-9398-4a8d-a7dd-d08741e23167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495d1c83-4ed1-4326-9a94-0719930365f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73c9e7205bf490e9884a109fdc1cd16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:02Z,use_quota=True,user_id='6c526cf68747401eaac26cf181674d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9afeb1e-c070-4c82-acec-90d28ab978dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9afeb1e-c070-4c82-acec-90d28ab978dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b778bb1-dbdd-43ec-bf19-918f46107838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b778bb1-dbdd-43ec-bf19-918f46107838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '495d1c83-4ed1-4326-9a94-0719930365f7', 'volume_name': 'volume-495d1c83-4ed1-4326-9a94-0719930365f7', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642b0628-4c7a-415c-b7b6-13b1148bc7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642b0628-4c7a-415c-b7b6-13b1148bc7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a4a7db-6048-43d4-ba52-9cb60b49992a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:02 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Volume 495d1c83-4ed1-4326-9a94-0719930365f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-495d1c83-4ed1-4326-9a94-0719930365f7', 'volume_size': 1} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495d1c83-4ed1-4326-9a94-0719930365f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73c9e7205bf490e9884a109fdc1cd16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:02Z,use_quota=True,user_id='6c526cf68747401eaac26cf181674d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Creating volume 495d1c83-4ed1-4326-9a94-0719930365f7 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:19:02 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-495d1c83-4ed1-4326-9a94-0719930365f7 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:02 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-495d1c83-4ed1-4326-9a94-0719930365f7 1073741824 Sep 01 12:19:02 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:02 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-495d1c83-4ed1-4326-9a94-0719930365f7 1073741824" returned: 0 in 0.436s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-495d1c83-4ed1-4326-9a94-0719930365f7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:02 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-495d1c83-4ed1-4326-9a94-0719930365f7 Sep 01 12:19:02 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:02 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-495d1c83-4ed1-4326-9a94-0719930365f7" returned: 0 in 0.265s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a4a7db-6048-43d4-ba52-9cb60b49992a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-495d1c83-4ed1-4326-9a94-0719930365f7', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7eab1b-5e9c-4eed-8635-63c3a10cd11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:02 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Volume volume-495d1c83-4ed1-4326-9a94-0719930365f7 (495d1c83-4ed1-4326-9a94-0719930365f7): created successfully Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7eab1b-5e9c-4eed-8635-63c3a10cd11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Flow 'volume_create_manager' (00dc417c-933b-490b-b429-31065bee82ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5b83fb44-1dc2-4180-9d23-7d24f7e2ed98 tempest-VolumesListAdminTestJSON-2135414671 None] Created volume successfully. Sep 01 12:19:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-580eeb38-96fb-4557-a14c-aa84033720b1 tempest-VolumesListAdminTestJSON-2135414671 None] Acquiring lock "cinder-495d1c83-4ed1-4326-9a94-0719930365f7-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-580eeb38-96fb-4557-a14c-aa84033720b1 tempest-VolumesListAdminTestJSON-2135414671 None] Lock "cinder-495d1c83-4ed1-4326-9a94-0719930365f7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-580eeb38-96fb-4557-a14c-aa84033720b1 tempest-VolumesListAdminTestJSON-2135414671 None] Acquiring lock "cinder-quobyte-495d1c83-4ed1-4326-9a94-0719930365f7" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-580eeb38-96fb-4557-a14c-aa84033720b1 tempest-VolumesListAdminTestJSON-2135414671 None] Lock "cinder-quobyte-495d1c83-4ed1-4326-9a94-0719930365f7" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:03 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdafdddf-2053-449c-809c-e1a33e401fc0]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-580eeb38-96fb-4557-a14c-aa84033720b1 tempest-VolumesListAdminTestJSON-2135414671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-495d1c83-4ed1-4326-9a94-0719930365f7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bd4a0bcd-3755-4f9a-94bb-2553e790d899 tempest-VolumesListAdminTestJSON-601449589 None] Acquiring lock "cinder-46c1f177-9c99-4c74-aa80-6fbfbe05bedb-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bd4a0bcd-3755-4f9a-94bb-2553e790d899 tempest-VolumesListAdminTestJSON-601449589 None] Lock "cinder-46c1f177-9c99-4c74-aa80-6fbfbe05bedb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bd4a0bcd-3755-4f9a-94bb-2553e790d899 tempest-VolumesListAdminTestJSON-601449589 None] Acquiring lock "cinder-quobyte-46c1f177-9c99-4c74-aa80-6fbfbe05bedb" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:03 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-495d1c83-4ed1-4326-9a94-0719930365f7 Sep 01 12:19:03 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bd4a0bcd-3755-4f9a-94bb-2553e790d899 tempest-VolumesListAdminTestJSON-601449589 None] Lock "cinder-quobyte-46c1f177-9c99-4c74-aa80-6fbfbe05bedb" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:03 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fb13de-8a61-44a0-8ecc-c9a130da172c]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bd4a0bcd-3755-4f9a-94bb-2553e790d899 tempest-VolumesListAdminTestJSON-601449589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-46c1f177-9c99-4c74-aa80-6fbfbe05bedb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:03 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-46c1f177-9c99-4c74-aa80-6fbfbe05bedb Sep 01 12:19:03 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:03 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-580eeb38-96fb-4557-a14c-aa84033720b1 tempest-VolumesListAdminTestJSON-2135414671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-495d1c83-4ed1-4326-9a94-0719930365f7" returned: 0 in 0.384s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-580eeb38-96fb-4557-a14c-aa84033720b1 tempest-VolumesListAdminTestJSON-2135414671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-495d1c83-4ed1-4326-9a94-0719930365f7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:03 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-495d1c83-4ed1-4326-9a94-0719930365f7 Sep 01 12:19:03 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:03 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bd4a0bcd-3755-4f9a-94bb-2553e790d899 tempest-VolumesListAdminTestJSON-601449589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-46c1f177-9c99-4c74-aa80-6fbfbe05bedb" returned: 0 in 0.348s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bd4a0bcd-3755-4f9a-94bb-2553e790d899 tempest-VolumesListAdminTestJSON-601449589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-46c1f177-9c99-4c74-aa80-6fbfbe05bedb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:04 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-46c1f177-9c99-4c74-aa80-6fbfbe05bedb Sep 01 12:19:04 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:04 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-580eeb38-96fb-4557-a14c-aa84033720b1 tempest-VolumesListAdminTestJSON-2135414671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-495d1c83-4ed1-4326-9a94-0719930365f7" returned: 0 in 0.241s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-580eeb38-96fb-4557-a14c-aa84033720b1 tempest-VolumesListAdminTestJSON-2135414671 None] Lock "cinder-quobyte-495d1c83-4ed1-4326-9a94-0719930365f7" released by "delete_volume" :: held 0.674s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-580eeb38-96fb-4557-a14c-aa84033720b1 tempest-VolumesListAdminTestJSON-2135414671 None] Created reservations ['fc8d519a-7086-4fb4-ad7a-c3bc7fbbf626', '1126160f-16a7-4a15-ad86-9abd7c4e37ae', '987442c9-7a5f-4e70-84d4-d1fcb5ffbbf3', '9d28ccd7-096e-480c-9032-f0dac848d32c'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-580eeb38-96fb-4557-a14c-aa84033720b1 tempest-VolumesListAdminTestJSON-2135414671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-580eeb38-96fb-4557-a14c-aa84033720b1 tempest-VolumesListAdminTestJSON-2135414671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-580eeb38-96fb-4557-a14c-aa84033720b1 tempest-VolumesListAdminTestJSON-2135414671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-580eeb38-96fb-4557-a14c-aa84033720b1 tempest-VolumesListAdminTestJSON-2135414671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-580eeb38-96fb-4557-a14c-aa84033720b1 tempest-VolumesListAdminTestJSON-2135414671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-580eeb38-96fb-4557-a14c-aa84033720b1 tempest-VolumesListAdminTestJSON-2135414671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:04 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bd4a0bcd-3755-4f9a-94bb-2553e790d899 tempest-VolumesListAdminTestJSON-601449589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-46c1f177-9c99-4c74-aa80-6fbfbe05bedb" returned: 0 in 0.253s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:04 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bd4a0bcd-3755-4f9a-94bb-2553e790d899 tempest-VolumesListAdminTestJSON-601449589 None] Lock "cinder-quobyte-46c1f177-9c99-4c74-aa80-6fbfbe05bedb" released by "delete_volume" :: held 0.652s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:04 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-bd4a0bcd-3755-4f9a-94bb-2553e790d899 tempest-VolumesListAdminTestJSON-601449589 None] Created reservations ['0e208b37-bb0d-4ad1-ad76-421ff7e72d5e', '8547959a-09c1-4b62-b72e-5f29c4b6347a', 'bae17506-9d7d-4f07-b612-aca4b8d14e27', 'caadf7b6-22c9-443b-8052-b6c87287bd02'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bd4a0bcd-3755-4f9a-94bb-2553e790d899 tempest-VolumesListAdminTestJSON-601449589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bd4a0bcd-3755-4f9a-94bb-2553e790d899 tempest-VolumesListAdminTestJSON-601449589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-bd4a0bcd-3755-4f9a-94bb-2553e790d899 tempest-VolumesListAdminTestJSON-601449589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-bd4a0bcd-3755-4f9a-94bb-2553e790d899 tempest-VolumesListAdminTestJSON-601449589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bd4a0bcd-3755-4f9a-94bb-2553e790d899 tempest-VolumesListAdminTestJSON-601449589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bd4a0bcd-3755-4f9a-94bb-2553e790d899 tempest-VolumesListAdminTestJSON-601449589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:04 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:19:04 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:04 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-580eeb38-96fb-4557-a14c-aa84033720b1 tempest-VolumesListAdminTestJSON-2135414671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.401s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-580eeb38-96fb-4557-a14c-aa84033720b1 tempest-VolumesListAdminTestJSON-2135414671 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:19:04 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-580eeb38-96fb-4557-a14c-aa84033720b1 tempest-VolumesListAdminTestJSON-2135414671 None] Deleted volume successfully. Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-580eeb38-96fb-4557-a14c-aa84033720b1 tempest-VolumesListAdminTestJSON-2135414671 None] Lock "cinder-495d1c83-4ed1-4326-9a94-0719930365f7-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:04 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bd4a0bcd-3755-4f9a-94bb-2553e790d899 tempest-VolumesListAdminTestJSON-601449589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.308s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-bd4a0bcd-3755-4f9a-94bb-2553e790d899 tempest-VolumesListAdminTestJSON-601449589 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:19:04 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-bd4a0bcd-3755-4f9a-94bb-2553e790d899 tempest-VolumesListAdminTestJSON-601449589 None] Deleted volume successfully. Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bd4a0bcd-3755-4f9a-94bb-2553e790d899 tempest-VolumesListAdminTestJSON-601449589 None] Lock "cinder-46c1f177-9c99-4c74-aa80-6fbfbe05bedb-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-57ea2930-5f4f-40cd-9417-00e5d920fc04 tempest-VolumesListAdminTestJSON-601449589 None] Acquiring lock "cinder-c687dac4-116b-4419-b99b-1e770b46e2cd-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-57ea2930-5f4f-40cd-9417-00e5d920fc04 tempest-VolumesListAdminTestJSON-601449589 None] Lock "cinder-c687dac4-116b-4419-b99b-1e770b46e2cd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-57ea2930-5f4f-40cd-9417-00e5d920fc04 tempest-VolumesListAdminTestJSON-601449589 None] Acquiring lock "cinder-quobyte-c687dac4-116b-4419-b99b-1e770b46e2cd" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-57ea2930-5f4f-40cd-9417-00e5d920fc04 tempest-VolumesListAdminTestJSON-601449589 None] Lock "cinder-quobyte-c687dac4-116b-4419-b99b-1e770b46e2cd" acquired by "delete_volume" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[af74f818-0ada-4f35-9c33-88dcd2a24cb0]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-57ea2930-5f4f-40cd-9417-00e5d920fc04 tempest-VolumesListAdminTestJSON-601449589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c687dac4-116b-4419-b99b-1e770b46e2cd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:05 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c687dac4-116b-4419-b99b-1e770b46e2cd Sep 01 12:19:05 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:05 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-57ea2930-5f4f-40cd-9417-00e5d920fc04 tempest-VolumesListAdminTestJSON-601449589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c687dac4-116b-4419-b99b-1e770b46e2cd" returned: 0 in 0.380s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-57ea2930-5f4f-40cd-9417-00e5d920fc04 tempest-VolumesListAdminTestJSON-601449589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c687dac4-116b-4419-b99b-1e770b46e2cd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:05 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c687dac4-116b-4419-b99b-1e770b46e2cd Sep 01 12:19:05 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:05 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-57ea2930-5f4f-40cd-9417-00e5d920fc04 tempest-VolumesListAdminTestJSON-601449589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c687dac4-116b-4419-b99b-1e770b46e2cd" returned: 0 in 0.271s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-57ea2930-5f4f-40cd-9417-00e5d920fc04 tempest-VolumesListAdminTestJSON-601449589 None] Lock "cinder-quobyte-c687dac4-116b-4419-b99b-1e770b46e2cd" released by "delete_volume" :: held 0.704s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:05 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-57ea2930-5f4f-40cd-9417-00e5d920fc04 tempest-VolumesListAdminTestJSON-601449589 None] Created reservations ['0c2a61d5-26d8-4595-941d-dacceafc6217', 'fa25b8d1-4f98-4f5d-87d7-430e93a06432', '55e26d60-b1a5-42fb-85b7-1475abfde170', '908965b8-93ee-4f50-b248-ba85c18333f9'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:19:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-57ea2930-5f4f-40cd-9417-00e5d920fc04 tempest-VolumesListAdminTestJSON-601449589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-57ea2930-5f4f-40cd-9417-00e5d920fc04 tempest-VolumesListAdminTestJSON-601449589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-57ea2930-5f4f-40cd-9417-00e5d920fc04 tempest-VolumesListAdminTestJSON-601449589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-57ea2930-5f4f-40cd-9417-00e5d920fc04 tempest-VolumesListAdminTestJSON-601449589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-57ea2930-5f4f-40cd-9417-00e5d920fc04 tempest-VolumesListAdminTestJSON-601449589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-57ea2930-5f4f-40cd-9417-00e5d920fc04 tempest-VolumesListAdminTestJSON-601449589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:05 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:19:05 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:06 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-57ea2930-5f4f-40cd-9417-00e5d920fc04 tempest-VolumesListAdminTestJSON-601449589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.266s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:06 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-57ea2930-5f4f-40cd-9417-00e5d920fc04 tempest-VolumesListAdminTestJSON-601449589 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:19:06 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-57ea2930-5f4f-40cd-9417-00e5d920fc04 tempest-VolumesListAdminTestJSON-601449589 None] Deleted volume successfully. Sep 01 12:19:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-57ea2930-5f4f-40cd-9417-00e5d920fc04 tempest-VolumesListAdminTestJSON-601449589 None] Lock "cinder-c687dac4-116b-4419-b99b-1e770b46e2cd-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9e6c5053-11d4-487f-844f-960b672c3923 tempest-VolumesListAdminTestJSON-601449589 None] Acquiring lock "cinder-f85dade5-2cc6-4a62-87e1-6563a5481f43-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9e6c5053-11d4-487f-844f-960b672c3923 tempest-VolumesListAdminTestJSON-601449589 None] Lock "cinder-f85dade5-2cc6-4a62-87e1-6563a5481f43-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9e6c5053-11d4-487f-844f-960b672c3923 tempest-VolumesListAdminTestJSON-601449589 None] Acquiring lock "cinder-quobyte-f85dade5-2cc6-4a62-87e1-6563a5481f43" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9e6c5053-11d4-487f-844f-960b672c3923 tempest-VolumesListAdminTestJSON-601449589 None] Lock "cinder-quobyte-f85dade5-2cc6-4a62-87e1-6563a5481f43" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:06 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bab91f2-35cb-434c-bcb2-dbb659fa7e85]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9e6c5053-11d4-487f-844f-960b672c3923 tempest-VolumesListAdminTestJSON-601449589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f85dade5-2cc6-4a62-87e1-6563a5481f43 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:06 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f85dade5-2cc6-4a62-87e1-6563a5481f43 Sep 01 12:19:06 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:06 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9e6c5053-11d4-487f-844f-960b672c3923 tempest-VolumesListAdminTestJSON-601449589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f85dade5-2cc6-4a62-87e1-6563a5481f43" returned: 0 in 0.401s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9e6c5053-11d4-487f-844f-960b672c3923 tempest-VolumesListAdminTestJSON-601449589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f85dade5-2cc6-4a62-87e1-6563a5481f43 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:06 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f85dade5-2cc6-4a62-87e1-6563a5481f43 Sep 01 12:19:06 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:06 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9e6c5053-11d4-487f-844f-960b672c3923 tempest-VolumesListAdminTestJSON-601449589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f85dade5-2cc6-4a62-87e1-6563a5481f43" returned: 0 in 0.262s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9e6c5053-11d4-487f-844f-960b672c3923 tempest-VolumesListAdminTestJSON-601449589 None] Lock "cinder-quobyte-f85dade5-2cc6-4a62-87e1-6563a5481f43" released by "delete_volume" :: held 0.709s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:06 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-9e6c5053-11d4-487f-844f-960b672c3923 tempest-VolumesListAdminTestJSON-601449589 None] Created reservations ['2d090d7a-70cd-47f8-911c-7ba0d7ce0028', '09497569-cb84-4fa1-ad75-d32fe99e4e51', '244b0a18-f77c-498a-a897-5f91f513a87a', '555546ae-563d-45d1-a747-ababcace82c7'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:19:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9e6c5053-11d4-487f-844f-960b672c3923 tempest-VolumesListAdminTestJSON-601449589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9e6c5053-11d4-487f-844f-960b672c3923 tempest-VolumesListAdminTestJSON-601449589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9e6c5053-11d4-487f-844f-960b672c3923 tempest-VolumesListAdminTestJSON-601449589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9e6c5053-11d4-487f-844f-960b672c3923 tempest-VolumesListAdminTestJSON-601449589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9e6c5053-11d4-487f-844f-960b672c3923 tempest-VolumesListAdminTestJSON-601449589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9e6c5053-11d4-487f-844f-960b672c3923 tempest-VolumesListAdminTestJSON-601449589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:07 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:19:07 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:07 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9e6c5053-11d4-487f-844f-960b672c3923 tempest-VolumesListAdminTestJSON-601449589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.255s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:07 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-9e6c5053-11d4-487f-844f-960b672c3923 tempest-VolumesListAdminTestJSON-601449589 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:19:07 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9e6c5053-11d4-487f-844f-960b672c3923 tempest-VolumesListAdminTestJSON-601449589 None] Deleted volume successfully. Sep 01 12:19:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9e6c5053-11d4-487f-844f-960b672c3923 tempest-VolumesListAdminTestJSON-601449589 None] Lock "cinder-f85dade5-2cc6-4a62-87e1-6563a5481f43-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:14 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:19:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Flow 'volume_create_manager' (a34a05c1-8e59-4b93-8868-95356cba81df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbeb3d70-6799-4baa-9e4c-9af07a0477e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbeb3d70-6799-4baa-9e4c-9af07a0477e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1867826635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ddf0f7-8037-47e5-8d77-841a012d495d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707130c52989497eb0916d8a0fff975f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:15Z,use_quota=True,user_id='0cc70cc6341d459f9f307cb3502c4944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f052367d-d8b8-4280-a5ff-1ee4f8e84203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f052367d-d8b8-4280-a5ff-1ee4f8e84203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b6a35f-07c3-4c1f-ab16-55542ec1326b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:14 devstack cinder-volume[87084]: DEBUG cinder.image.glance [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Creating Keystone auth plugin from conf {{(pid=87084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 12:19:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b6a35f-07c3-4c1f-ab16-55542ec1326b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f3ddf0f7-8037-47e5-8d77-841a012d495d', 'volume_name': 'volume-f3ddf0f7-8037-47e5-8d77-841a012d495d', 'volume_size': 1, 'image_id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42fce3cc35724a058187a1135a373ea9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'created_at': datetime.datetime(2026, 9, 1, 9, 59, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 59, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a69eeb-09dd-4790-abfa-27e72bb83b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a69eeb-09dd-4790-abfa-27e72bb83b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb093c3-3056-4e92-8c94-611bf7bf9934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:14 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Volume f3ddf0f7-8037-47e5-8d77-841a012d495d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f3ddf0f7-8037-47e5-8d77-841a012d495d', 'volume_size': 1, 'image_id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42fce3cc35724a058187a1135a373ea9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'created_at': datetime.datetime(2026, 9, 1, 9, 59, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 59, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 12:19:14 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Trying to clone f3ddf0f7-8037-47e5-8d77-841a012d495d from image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}]). {{(pid=87084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 12:19:15 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_gnahmtgndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 12:19:15 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Image download 20.69 MB at 20.69 MB/s Sep 01 12:19:15 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbe5be6-91da-4b3c-b979-863e339280e9]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_gnahmtgndevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:15 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_gnahmtgndevstack@QuobyteHD Sep 01 12:19:15 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:15 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_gnahmtgndevstack@QuobyteHD" returned: 0 in 0.535s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:15 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Temporary image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c is fetched for user 0cc70cc6341d459f9f307cb3502c4944. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 12:19:16 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e394776-8d9a-4842-82f7-06c83e6143f0]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_gnahmtgndevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:16 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_gnahmtgndevstack@QuobyteHD Sep 01 12:19:16 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:16 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_gnahmtgndevstack@QuobyteHD" returned: 0 in 0.581s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1867826635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ddf0f7-8037-47e5-8d77-841a012d495d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707130c52989497eb0916d8a0fff975f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:15Z,use_quota=True,user_id='0cc70cc6341d459f9f307cb3502c4944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:19:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Creating volume f3ddf0f7-8037-47e5-8d77-841a012d495d {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:19:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:19:16 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:19:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f3ddf0f7-8037-47e5-8d77-841a012d495d 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:16 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f3ddf0f7-8037-47e5-8d77-841a012d495d 1073741824 Sep 01 12:19:16 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:17 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f3ddf0f7-8037-47e5-8d77-841a012d495d 1073741824" returned: 0 in 0.563s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f3ddf0f7-8037-47e5-8d77-841a012d495d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:17 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f3ddf0f7-8037-47e5-8d77-841a012d495d Sep 01 12:19:17 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:17 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:19:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Flow 'volume_create_manager' (e5ee4429-07c0-404b-ac8a-3946916a263f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582d01eb-c90a-4528-872a-f4d35a48804d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582d01eb-c90a-4528-872a-f4d35a48804d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81cfafa1-bbe5-462b-8560-777598e7c913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60384677c0d498fb3f7a6930161b784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:18Z,use_quota=True,user_id='a1421231307843b69f3b708454271b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a68d982d-3627-47d7-86b1-1698cf64b107),volume_type_id=a68d982d-3627-47d7-86b1-1698cf64b107)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b357a2cb-f208-424b-9ad0-5db3c6d26963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b357a2cb-f208-424b-9ad0-5db3c6d26963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aebe24f2-7148-458d-b4fb-431a75976264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:17 devstack cinder-volume[87084]: DEBUG cinder.image.glance [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Creating Keystone auth plugin from conf {{(pid=87084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 12:19:17 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-390c2b17-a834-406b-9021-6db23c1e2ca9 tempest-TestShelveInstance-1786574594 None] Terminate volume connection completed successfully. Sep 01 12:19:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-390c2b17-a834-406b-9021-6db23c1e2ca9 tempest-TestShelveInstance-1786574594 None] Deleting attachment 52d2beaf-b701-4304-ad20-307963684e99. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:19:17 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f3ddf0f7-8037-47e5-8d77-841a012d495d" returned: 0 in 0.390s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:19:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:17 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Attempting download of 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c ((None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}])) to volume f3ddf0f7-8037-47e5-8d77-841a012d495d. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 12:19:17 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4298d12-06f1-4953-a818-50796b1e3504]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_076w10m1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-6d0750ee-606f-4b5c-854b-e5a07326193b tempest-TestShelveInstance-1786574594 None] Acquiring lock "cinder-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-6d0750ee-606f-4b5c-854b-e5a07326193b tempest-TestShelveInstance-1786574594 None] Lock "cinder-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aebe24f2-7148-458d-b4fb-431a75976264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '81cfafa1-bbe5-462b-8560-777598e7c913', 'volume_name': 'volume-81cfafa1-bbe5-462b-8560-777598e7c913', 'volume_size': 1, 'image_id': '36cc8422-4e6d-4a4f-9179-90e197eb12c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36cc8422-4e6d-4a4f-9179-90e197eb12c6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8976f56a21ab4dbab693ce9d084afdd0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a60384677c0d498fb3f7a6930161b784', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8ebfc05f10530314b4bacbf6c2c2d93c670f9dc76347ab7923fa1e3da1772d98cccb8e23acfd62ec6b7a3635a1710c0dce7a2881692ca61af422dd248dbe6e82', 'id': '36cc8422-4e6d-4a4f-9179-90e197eb12c6', 'created_at': datetime.datetime(2026, 9, 1, 10, 19, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 19, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36cc8422-4e6d-4a4f-9179-90e197eb12c6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f61ebab-b20e-4a8b-af85-f1e7165ce098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f61ebab-b20e-4a8b-af85-f1e7165ce098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65f9295e-c11a-4358-bdb8-f5962bf1c025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:18 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Volume 81cfafa1-bbe5-462b-8560-777598e7c913: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-81cfafa1-bbe5-462b-8560-777598e7c913', 'volume_size': 1, 'image_id': '36cc8422-4e6d-4a4f-9179-90e197eb12c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36cc8422-4e6d-4a4f-9179-90e197eb12c6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8976f56a21ab4dbab693ce9d084afdd0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a60384677c0d498fb3f7a6930161b784', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8ebfc05f10530314b4bacbf6c2c2d93c670f9dc76347ab7923fa1e3da1772d98cccb8e23acfd62ec6b7a3635a1710c0dce7a2881692ca61af422dd248dbe6e82', 'id': '36cc8422-4e6d-4a4f-9179-90e197eb12c6', 'created_at': datetime.datetime(2026, 9, 1, 10, 19, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 19, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36cc8422-4e6d-4a4f-9179-90e197eb12c6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Trying to clone 81cfafa1-bbe5-462b-8560-777598e7c913 from image 36cc8422-4e6d-4a4f-9179-90e197eb12c6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/36cc8422-4e6d-4a4f-9179-90e197eb12c6', 'metadata': {}}]). {{(pid=87084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-6d0750ee-606f-4b5c-854b-e5a07326193b tempest-TestShelveInstance-1786574594 None] Acquiring lock "cinder-quobyte-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:18 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_076w10m1 Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-6d0750ee-606f-4b5c-854b-e5a07326193b tempest-TestShelveInstance-1786574594 None] Lock "cinder-quobyte-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b" acquired by "delete_volume" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:18 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[901805c3-6142-4900-aef6-fbc18261ab66]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-6d0750ee-606f-4b5c-854b-e5a07326193b tempest-TestShelveInstance-1786574594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 12:19:18 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Image download 0.00 MB at 0.00 MB/s Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae90877f-d036-4ae4-8f08-74200b4858c8]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:18 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b Sep 01 12:19:18 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:18 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_076w10m1" returned: 0 in 0.406s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_076w10m1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:18 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD Sep 01 12:19:18 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:18 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_076w10m1 Sep 01 12:19:18 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:18 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-6d0750ee-606f-4b5c-854b-e5a07326193b tempest-TestShelveInstance-1786574594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b" returned: 0 in 0.477s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-6d0750ee-606f-4b5c-854b-e5a07326193b tempest-TestShelveInstance-1786574594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:18 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b Sep 01 12:19:18 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:18 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:18 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_076w10m1" returned: 1 in 0.367s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_076w10m1' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dde737-f30a-449c-a4cb-c7523298bbe8]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_gnahmtgndevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:18 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD Sep 01 12:19:18 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:18 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-6d0750ee-606f-4b5c-854b-e5a07326193b tempest-TestShelveInstance-1786574594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b" returned: 0 in 0.273s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:18 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_gnahmtgndevstack@QuobyteHD Sep 01 12:19:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-6d0750ee-606f-4b5c-854b-e5a07326193b tempest-TestShelveInstance-1786574594 None] Lock "cinder-quobyte-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b" released by "delete_volume" :: held 0.812s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:18 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:19 devstack cinder-volume[87084]: DEBUG cinder.quota [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-6d0750ee-606f-4b5c-854b-e5a07326193b tempest-TestShelveInstance-1786574594 None] Created reservations ['a48db7e7-c563-4f04-9e90-9c6bb115d253', 'd730c39e-c4bc-4af5-8b56-317cf07c2ac8', '7fbd6e9f-ede3-4036-a398-7fd2273aa1cd', '6ae06004-8552-4821-99c4-ab2878a0279b'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:19:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-6d0750ee-606f-4b5c-854b-e5a07326193b tempest-TestShelveInstance-1786574594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-6d0750ee-606f-4b5c-854b-e5a07326193b tempest-TestShelveInstance-1786574594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-6d0750ee-606f-4b5c-854b-e5a07326193b tempest-TestShelveInstance-1786574594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-6d0750ee-606f-4b5c-854b-e5a07326193b tempest-TestShelveInstance-1786574594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-6d0750ee-606f-4b5c-854b-e5a07326193b tempest-TestShelveInstance-1786574594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-6d0750ee-606f-4b5c-854b-e5a07326193b tempest-TestShelveInstance-1786574594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:19 devstack sudo[101862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:19:19 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:19 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD" returned: 1 in 0.488s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:19:19 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Temporary image 36cc8422-4e6d-4a4f-9179-90e197eb12c6 is fetched for user a1421231307843b69f3b708454271b40. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 12:19:19 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_gnahmtgndevstack@QuobyteHD" returned: 0 in 0.450s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:19 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c was qcow2, converting to qcow2 {{(pid=87084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 12:19:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_gnahmtgndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f3ddf0f7-8037-47e5-8d77-841a012d495d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:19 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_gnahmtgndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f3ddf0f7-8037-47e5-8d77-841a012d495d Sep 01 12:19:19 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:19 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f042b56-59ff-4acf-b342-5f750b0de563]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:19 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD Sep 01 12:19:19 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:19 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-6d0750ee-606f-4b5c-854b-e5a07326193b tempest-TestShelveInstance-1786574594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.387s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:19 devstack cinder-volume[87084]: DEBUG cinder.manager [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-6d0750ee-606f-4b5c-854b-e5a07326193b tempest-TestShelveInstance-1786574594 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:19:19 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-6d0750ee-606f-4b5c-854b-e5a07326193b tempest-TestShelveInstance-1786574594 None] Deleted volume successfully. Sep 01 12:19:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [req-b3159dc7-f258-497b-af62-041ee610f8e8 req-6d0750ee-606f-4b5c-854b-e5a07326193b tempest-TestShelveInstance-1786574594 None] Lock "cinder-6d40bbe3-eb44-4085-b0a8-8eda7b2a812b-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:19 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:19 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD Sep 01 12:19:19 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:20 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:19:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81cfafa1-bbe5-462b-8560-777598e7c913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60384677c0d498fb3f7a6930161b784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:18Z,use_quota=True,user_id='a1421231307843b69f3b708454271b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a68d982d-3627-47d7-86b1-1698cf64b107),volume_type_id=a68d982d-3627-47d7-86b1-1698cf64b107)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:19:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Creating volume 81cfafa1-bbe5-462b-8560-777598e7c913 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:19:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:19:20 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:19:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-81cfafa1-bbe5-462b-8560-777598e7c913 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:20 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-81cfafa1-bbe5-462b-8560-777598e7c913 1073741824 Sep 01 12:19:20 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:20 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-81cfafa1-bbe5-462b-8560-777598e7c913 1073741824" returned: 0 in 0.527s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-81cfafa1-bbe5-462b-8560-777598e7c913 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:20 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-81cfafa1-bbe5-462b-8560-777598e7c913 Sep 01 12:19:20 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:20 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-81cfafa1-bbe5-462b-8560-777598e7c913" returned: 0 in 0.306s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:19:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Attempting download of 36cc8422-4e6d-4a4f-9179-90e197eb12c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/36cc8422-4e6d-4a4f-9179-90e197eb12c6', 'metadata': {}}])) to volume 81cfafa1-bbe5-462b-8560-777598e7c913. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e056417-49e6-4276-8840-707d7898b84f]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36cc8422-4e6d-4a4f-9179-90e197eb12c6_064hs519 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:21 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_gnahmtgndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f3ddf0f7-8037-47e5-8d77-841a012d495d" returned: 0 in 1.971s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8b6d23d5-cf6b-4f62-bc24-7a262454ec8c_gnahmtgndevstack@QuobyteHD, size 112.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f3ddf0f7-8037-47e5-8d77-841a012d495d {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:19:21 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Converted 112.00 MB image at 56.80 MB/s Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f3ddf0f7-8037-47e5-8d77-841a012d495d 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:21 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36cc8422-4e6d-4a4f-9179-90e197eb12c6_064hs519 Sep 01 12:19:21 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:21 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f3ddf0f7-8037-47e5-8d77-841a012d495d 1G Sep 01 12:19:21 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:21 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36cc8422-4e6d-4a4f-9179-90e197eb12c6_064hs519" returned: 0 in 0.348s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36cc8422-4e6d-4a4f-9179-90e197eb12c6_064hs519 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:21 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f3ddf0f7-8037-47e5-8d77-841a012d495d 1G" returned: 0 in 0.341s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Downloaded image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c ((None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}])) to volume f3ddf0f7-8037-47e5-8d77-841a012d495d successfully. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Temporary image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c for user 0cc70cc6341d459f9f307cb3502c4944 is deleted. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Marking volume f3ddf0f7-8037-47e5-8d77-841a012d495d as bootable. {{(pid=87084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 12:19:21 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36cc8422-4e6d-4a4f-9179-90e197eb12c6_064hs519 Sep 01 12:19:21 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Copying metadata from image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c to f3ddf0f7-8037-47e5-8d77-841a012d495d. {{(pid=87084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Creating volume glance metadata for volume f3ddf0f7-8037-47e5-8d77-841a012d495d backed by image 8b6d23d5-cf6b-4f62-bc24-7a262454ec8c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb093c3-3056-4e92-8c94-611bf7bf9934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3ddf0f7-8037-47e5-8d77-841a012d495d', 'volume_size': 1, 'image_id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42fce3cc35724a058187a1135a373ea9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b6d23d5-cf6b-4f62-bc24-7a262454ec8c', 'created_at': datetime.datetime(2026, 9, 1, 9, 59, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 9, 59, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b6d23d5-cf6b-4f62-bc24-7a262454ec8c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac326f33-33f6-450a-9b75-ffe2aec73c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:21 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Volume volume-f3ddf0f7-8037-47e5-8d77-841a012d495d (f3ddf0f7-8037-47e5-8d77-841a012d495d): created successfully Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac326f33-33f6-450a-9b75-ffe2aec73c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Flow 'volume_create_manager' (a34a05c1-8e59-4b93-8868-95356cba81df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:21 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a499a160-a23a-4236-b907-dd90504233fd tempest-VolumesImageMetadata-1116890042 None] Created volume successfully. Sep 01 12:19:21 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36cc8422-4e6d-4a4f-9179-90e197eb12c6_064hs519" returned: 1 in 0.358s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36cc8422-4e6d-4a4f-9179-90e197eb12c6_064hs519' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1876f76a-64f6-49e3-bd75-75be0374cf87]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:21 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD Sep 01 12:19:21 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:22 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:22 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD Sep 01 12:19:22 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:22 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD" returned: 1 in 0.366s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:19:22 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] 36cc8422-4e6d-4a4f-9179-90e197eb12c6 was raw, converting to qcow2 {{(pid=87084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 12:19:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-81cfafa1-bbe5-462b-8560-777598e7c913 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:22 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-81cfafa1-bbe5-462b-8560-777598e7c913 Sep 01 12:19:22 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-664a1d49-f456-4059-b330-db4ca27283da tempest-VolumesImageMetadata-1116890042 None] Acquiring lock "cinder-f3ddf0f7-8037-47e5-8d77-841a012d495d-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-664a1d49-f456-4059-b330-db4ca27283da tempest-VolumesImageMetadata-1116890042 None] Lock "cinder-f3ddf0f7-8037-47e5-8d77-841a012d495d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-664a1d49-f456-4059-b330-db4ca27283da tempest-VolumesImageMetadata-1116890042 None] Acquiring lock "cinder-quobyte-f3ddf0f7-8037-47e5-8d77-841a012d495d" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-664a1d49-f456-4059-b330-db4ca27283da tempest-VolumesImageMetadata-1116890042 None] Lock "cinder-quobyte-f3ddf0f7-8037-47e5-8d77-841a012d495d" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:22 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef99c161-74fc-4af2-8384-353e1aa70a21]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-664a1d49-f456-4059-b330-db4ca27283da tempest-VolumesImageMetadata-1116890042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f3ddf0f7-8037-47e5-8d77-841a012d495d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:22 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f3ddf0f7-8037-47e5-8d77-841a012d495d Sep 01 12:19:22 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:23 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-81cfafa1-bbe5-462b-8560-777598e7c913" returned: 0 in 0.487s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_36cc8422-4e6d-4a4f-9179-90e197eb12c6_ojfe2dgxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-81cfafa1-bbe5-462b-8560-777598e7c913 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:19:23 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-81cfafa1-bbe5-462b-8560-777598e7c913 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:23 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-81cfafa1-bbe5-462b-8560-777598e7c913 1G Sep 01 12:19:23 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:23 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-664a1d49-f456-4059-b330-db4ca27283da tempest-VolumesImageMetadata-1116890042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f3ddf0f7-8037-47e5-8d77-841a012d495d" returned: 0 in 0.477s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-664a1d49-f456-4059-b330-db4ca27283da tempest-VolumesImageMetadata-1116890042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f3ddf0f7-8037-47e5-8d77-841a012d495d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:23 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f3ddf0f7-8037-47e5-8d77-841a012d495d Sep 01 12:19:23 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:23 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-81cfafa1-bbe5-462b-8560-777598e7c913 1G" returned: 0 in 0.441s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Downloaded image 36cc8422-4e6d-4a4f-9179-90e197eb12c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/36cc8422-4e6d-4a4f-9179-90e197eb12c6', 'metadata': {}}])) to volume 81cfafa1-bbe5-462b-8560-777598e7c913 successfully. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Temporary image 36cc8422-4e6d-4a4f-9179-90e197eb12c6 for user a1421231307843b69f3b708454271b40 is deleted. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Marking volume 81cfafa1-bbe5-462b-8560-777598e7c913 as bootable. {{(pid=87084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Copying metadata from image 36cc8422-4e6d-4a4f-9179-90e197eb12c6 to 81cfafa1-bbe5-462b-8560-777598e7c913. {{(pid=87084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Creating volume glance metadata for volume 81cfafa1-bbe5-462b-8560-777598e7c913 backed by image 36cc8422-4e6d-4a4f-9179-90e197eb12c6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '36cc8422-4e6d-4a4f-9179-90e197eb12c6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8976f56a21ab4dbab693ce9d084afdd0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 12:19:23 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-664a1d49-f456-4059-b330-db4ca27283da tempest-VolumesImageMetadata-1116890042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f3ddf0f7-8037-47e5-8d77-841a012d495d" returned: 0 in 0.283s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-664a1d49-f456-4059-b330-db4ca27283da tempest-VolumesImageMetadata-1116890042 None] Lock "cinder-quobyte-f3ddf0f7-8037-47e5-8d77-841a012d495d" released by "delete_volume" :: held 0.809s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65f9295e-c11a-4358-bdb8-f5962bf1c025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81cfafa1-bbe5-462b-8560-777598e7c913', 'volume_size': 1, 'image_id': '36cc8422-4e6d-4a4f-9179-90e197eb12c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36cc8422-4e6d-4a4f-9179-90e197eb12c6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8976f56a21ab4dbab693ce9d084afdd0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a60384677c0d498fb3f7a6930161b784', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8ebfc05f10530314b4bacbf6c2c2d93c670f9dc76347ab7923fa1e3da1772d98cccb8e23acfd62ec6b7a3635a1710c0dce7a2881692ca61af422dd248dbe6e82', 'id': '36cc8422-4e6d-4a4f-9179-90e197eb12c6', 'created_at': datetime.datetime(2026, 9, 1, 10, 19, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 19, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36cc8422-4e6d-4a4f-9179-90e197eb12c6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704ef691-3ddc-4ced-bb2d-e23e2b00b0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:23 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Volume volume-81cfafa1-bbe5-462b-8560-777598e7c913 (81cfafa1-bbe5-462b-8560-777598e7c913): created successfully Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704ef691-3ddc-4ced-bb2d-e23e2b00b0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Flow 'volume_create_manager' (e5ee4429-07c0-404b-ac8a-3946916a263f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-26657c63-d410-48d9-b1ed-192915f37ee4 tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Created volume successfully. Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-664a1d49-f456-4059-b330-db4ca27283da tempest-VolumesImageMetadata-1116890042 None] Created reservations ['a97a6832-2635-4839-8c23-119ad3b9b611', '15e1eea0-6bc3-4403-99d6-5b333b9ea014', '12bb0f5a-d57e-46fc-97cd-988068596d8e', '83dd7b4f-d434-43aa-b56e-cd45254b9723'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-664a1d49-f456-4059-b330-db4ca27283da tempest-VolumesImageMetadata-1116890042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-664a1d49-f456-4059-b330-db4ca27283da tempest-VolumesImageMetadata-1116890042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-664a1d49-f456-4059-b330-db4ca27283da tempest-VolumesImageMetadata-1116890042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-664a1d49-f456-4059-b330-db4ca27283da tempest-VolumesImageMetadata-1116890042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-664a1d49-f456-4059-b330-db4ca27283da tempest-VolumesImageMetadata-1116890042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-664a1d49-f456-4059-b330-db4ca27283da tempest-VolumesImageMetadata-1116890042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:23 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:19:23 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Acquiring lock "cinder-81cfafa1-bbe5-462b-8560-777598e7c913-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Lock "cinder-81cfafa1-bbe5-462b-8560-777598e7c913-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:24 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-664a1d49-f456-4059-b330-db4ca27283da tempest-VolumesImageMetadata-1116890042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.321s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:24 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-664a1d49-f456-4059-b330-db4ca27283da tempest-VolumesImageMetadata-1116890042 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:19:24 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-664a1d49-f456-4059-b330-db4ca27283da tempest-VolumesImageMetadata-1116890042 None] Deleted volume successfully. Sep 01 12:19:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-664a1d49-f456-4059-b330-db4ca27283da tempest-VolumesImageMetadata-1116890042 None] Lock "cinder-f3ddf0f7-8037-47e5-8d77-841a012d495d-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Acquiring lock "cinder-quobyte-81cfafa1-bbe5-462b-8560-777598e7c913" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Lock "cinder-quobyte-81cfafa1-bbe5-462b-8560-777598e7c913" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:24 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7504cf-69f1-4dc7-a306-1a57f9913da1]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-81cfafa1-bbe5-462b-8560-777598e7c913 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:24 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-81cfafa1-bbe5-462b-8560-777598e7c913 Sep 01 12:19:24 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:24 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-81cfafa1-bbe5-462b-8560-777598e7c913" returned: 0 in 0.404s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-81cfafa1-bbe5-462b-8560-777598e7c913 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:24 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-81cfafa1-bbe5-462b-8560-777598e7c913 Sep 01 12:19:24 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:24 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-81cfafa1-bbe5-462b-8560-777598e7c913" returned: 0 in 0.331s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Lock "cinder-quobyte-81cfafa1-bbe5-462b-8560-777598e7c913" released by "delete_volume" :: held 0.783s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:24 devstack cinder-volume[87084]: WARNING cinder.quota [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:19:24 devstack cinder-volume[87084]: WARNING cinder.quota [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:19:25 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Created reservations ['29a75874-4299-4279-ab9d-3217ca54f458', '450ebd1c-0fd2-4e8d-945f-0c51b4ece8a2', '051cae08-704b-4512-a605-c87b85e6f40b', '57a4c426-7526-44e2-b158-4ea1d8db4e96'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:19:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:25 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:19:25 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:25 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.339s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:25 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:19:25 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Deleted volume successfully. Sep 01 12:19:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-af60fdb7-8ba1-4bcc-8bb9-d6b8e4efda6f tempest-VolumeAndVolumeTypeFromImageTest-338009680 None] Lock "cinder-81cfafa1-bbe5-462b-8560-777598e7c913-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=143,cinder:INSERT=49,cinder:UPDATE=145,cinder:DELETE=12 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Flow 'volume_create_manager' (82c7d852-5c92-4b81-8879-2797c9111d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c55c5b1-41e1-4ebe-9b11-924a688bb02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c55c5b1-41e1-4ebe-9b11-924a688bb02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1818025181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19caa553-8cd6-44f0-aca7-c644af90fc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d52c1aeb0e0648428b8ed9e13279080f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:28Z,use_quota=True,user_id='3b1954005dd24aa980220dfe1305830b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93cfcec7-a115-4751-8888-01a955c16d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93cfcec7-a115-4751-8888-01a955c16d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e1c8db-735c-4d84-81c9-71df3943d867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e1c8db-735c-4d84-81c9-71df3943d867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19caa553-8cd6-44f0-aca7-c644af90fc59', 'volume_name': 'volume-19caa553-8cd6-44f0-aca7-c644af90fc59', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50376a1c-8466-42d4-887d-523801f3405b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50376a1c-8466-42d4-887d-523801f3405b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7030b542-c6e2-4d9c-925f-327e4fb933d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:27 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Volume 19caa553-8cd6-44f0-aca7-c644af90fc59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19caa553-8cd6-44f0-aca7-c644af90fc59', 'volume_size': 1} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1818025181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19caa553-8cd6-44f0-aca7-c644af90fc59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d52c1aeb0e0648428b8ed9e13279080f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:28Z,use_quota=True,user_id='3b1954005dd24aa980220dfe1305830b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Creating volume 19caa553-8cd6-44f0-aca7-c644af90fc59 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:19:27 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:19:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:27 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59 1073741824 Sep 01 12:19:27 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:28 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59 1073741824" returned: 0 in 0.527s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:28 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59 Sep 01 12:19:28 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:28 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59" returned: 0 in 0.325s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:19:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:28 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=123,cinder:INSERT=43,cinder:UPDATE=164,cinder:DELETE=11 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:19:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7030b542-c6e2-4d9c-925f-327e4fb933d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19caa553-8cd6-44f0-aca7-c644af90fc59', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917e525b-e3fd-4e4b-94eb-3abb1513f234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:28 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Volume volume-19caa553-8cd6-44f0-aca7-c644af90fc59 (19caa553-8cd6-44f0-aca7-c644af90fc59): created successfully Sep 01 12:19:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917e525b-e3fd-4e4b-94eb-3abb1513f234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:28 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Flow 'volume_create_manager' (82c7d852-5c92-4b81-8879-2797c9111d77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:28 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-96dea290-c4f9-406a-8025-7bd4c51424a7 tempest-SnapshotMetadataTestJSON-700512914 None] Created volume successfully. Sep 01 12:19:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b7b0d954-fb5b-487c-bc84-8464349d9b27 tempest-SnapshotMetadataTestJSON-700512914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b7b0d954-fb5b-487c-bc84-8464349d9b27 tempest-SnapshotMetadataTestJSON-700512914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:29 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b7b0d954-fb5b-487c-bc84-8464349d9b27 tempest-SnapshotMetadataTestJSON-700512914 None] Creating offline snapshot 4e9e9516-df81-40e9-916e-7bf2adb736af of volume 19caa553-8cd6-44f0-aca7-c644af90fc59 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:19:29 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa11b20e-fdbb-4437-912b-5b921f07cdd4]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7b0d954-fb5b-487c-bc84-8464349d9b27 tempest-SnapshotMetadataTestJSON-700512914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:30 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59 Sep 01 12:19:30 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:30 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7b0d954-fb5b-487c-bc84-8464349d9b27 tempest-SnapshotMetadataTestJSON-700512914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59" returned: 0 in 0.439s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7b0d954-fb5b-487c-bc84-8464349d9b27 tempest-SnapshotMetadataTestJSON-700512914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.4e9e9516-df81-40e9-916e-7bf2adb736af 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:30 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.4e9e9516-df81-40e9-916e-7bf2adb736af 1G Sep 01 12:19:30 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:30 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:19:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Flow 'volume_create_manager' (1f27ecd8-5e57-4215-b3d9-f131a28c1432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c9441b-6972-4aa4-bab1-9526e5f9062b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c9441b-6972-4aa4-bab1-9526e5f9062b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1046061393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b818f2-fd6e-415f-8d65-f12a5404ea97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019c699980594a7cbd23865d5d9c594f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:31Z,use_quota=True,user_id='4f59165f24364e5e9cd66d8f180c3f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c5ba3c-a29b-4a10-8eeb-798bb0525bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c5ba3c-a29b-4a10-8eeb-798bb0525bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bc042d-353c-4e64-bf8e-e27b8b1584f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bc042d-353c-4e64-bf8e-e27b8b1584f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5b818f2-fd6e-415f-8d65-f12a5404ea97', 'volume_name': 'volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0e4e33-5958-4604-82f3-802432bacf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0e4e33-5958-4604-82f3-802432bacf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:30 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c790a7-94c1-4474-a611-534611c8e457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:30 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Volume c5b818f2-fd6e-415f-8d65-f12a5404ea97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97', 'volume_size': 1} Sep 01 12:19:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:30 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7b0d954-fb5b-487c-bc84-8464349d9b27 tempest-SnapshotMetadataTestJSON-700512914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.4e9e9516-df81-40e9-916e-7bf2adb736af 1G" returned: 0 in 0.497s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7b0d954-fb5b-487c-bc84-8464349d9b27 tempest-SnapshotMetadataTestJSON-700512914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19caa553-8cd6-44f0-aca7-c644af90fc59 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.4e9e9516-df81-40e9-916e-7bf2adb736af {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:30 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19caa553-8cd6-44f0-aca7-c644af90fc59 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.4e9e9516-df81-40e9-916e-7bf2adb736af Sep 01 12:19:30 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:31 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7b0d954-fb5b-487c-bc84-8464349d9b27 tempest-SnapshotMetadataTestJSON-700512914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19caa553-8cd6-44f0-aca7-c644af90fc59 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.4e9e9516-df81-40e9-916e-7bf2adb736af" returned: 0 in 0.297s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:31 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-b7b0d954-fb5b-487c-bc84-8464349d9b27 tempest-SnapshotMetadataTestJSON-700512914 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.4e9e9516-df81-40e9-916e-7bf2adb736af is being set with open permissions: ugo+rw Sep 01 12:19:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7b0d954-fb5b-487c-bc84-8464349d9b27 tempest-SnapshotMetadataTestJSON-700512914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.4e9e9516-df81-40e9-916e-7bf2adb736af {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:31 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.4e9e9516-df81-40e9-916e-7bf2adb736af Sep 01 12:19:31 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:31 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7b0d954-fb5b-487c-bc84-8464349d9b27 tempest-SnapshotMetadataTestJSON-700512914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.4e9e9516-df81-40e9-916e-7bf2adb736af" returned: 0 in 0.264s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7b0d954-fb5b-487c-bc84-8464349d9b27 tempest-SnapshotMetadataTestJSON-700512914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:31 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.info Sep 01 12:19:31 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:31 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7b0d954-fb5b-487c-bc84-8464349d9b27 tempest-SnapshotMetadataTestJSON-700512914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.info" returned: 0 in 0.289s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:31 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-b7b0d954-fb5b-487c-bc84-8464349d9b27 tempest-SnapshotMetadataTestJSON-700512914 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.info is being set with open permissions: ugo+rw Sep 01 12:19:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7b0d954-fb5b-487c-bc84-8464349d9b27 tempest-SnapshotMetadataTestJSON-700512914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:31 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.info Sep 01 12:19:31 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:32 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b7b0d954-fb5b-487c-bc84-8464349d9b27 tempest-SnapshotMetadataTestJSON-700512914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.info" returned: 0 in 0.259s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b7b0d954-fb5b-487c-bc84-8464349d9b27 tempest-SnapshotMetadataTestJSON-700512914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.144s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.241s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1046061393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b818f2-fd6e-415f-8d65-f12a5404ea97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019c699980594a7cbd23865d5d9c594f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:31Z,use_quota=True,user_id='4f59165f24364e5e9cd66d8f180c3f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Creating volume c5b818f2-fd6e-415f-8d65-f12a5404ea97 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:19:32 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:32 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 1073741824 Sep 01 12:19:32 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:32 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b7b0d954-fb5b-487c-bc84-8464349d9b27 tempest-SnapshotMetadataTestJSON-700512914 None] Create snapshot completed successfully Sep 01 12:19:32 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 1073741824" returned: 0 in 0.455s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:32 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 Sep 01 12:19:32 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Flow 'volume_create_manager' (3a075327-1fe4-41e0-98cd-19f7da4914d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d4bab1-82e2-4ab9-b0df-1b48d7c6cd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d4bab1-82e2-4ab9-b0df-1b48d7c6cd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-171233446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf711a1a-55f5-42f9-8794-ae38bf44b3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab1d5b6771546cda103c5a459be7332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:33Z,use_quota=True,user_id='f8de6acd74084d8c935160caafca9424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda957eb-1ade-4903-968d-52613ea15561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda957eb-1ade-4903-968d-52613ea15561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414a9230-28aa-41ea-96e7-6b0e8280b26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414a9230-28aa-41ea-96e7-6b0e8280b26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf711a1a-55f5-42f9-8794-ae38bf44b3f1', 'volume_name': 'volume-cf711a1a-55f5-42f9-8794-ae38bf44b3f1', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99586ccd-2fca-4d4a-90b1-120f8c1017db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99586ccd-2fca-4d4a-90b1-120f8c1017db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73e8459-247f-4867-bfd7-28b6532ef0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:32 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Volume cf711a1a-55f5-42f9-8794-ae38bf44b3f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf711a1a-55f5-42f9-8794-ae38bf44b3f1', 'volume_size': 1} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:32 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97" returned: 0 in 0.289s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.037s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-171233446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf711a1a-55f5-42f9-8794-ae38bf44b3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab1d5b6771546cda103c5a459be7332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:33Z,use_quota=True,user_id='f8de6acd74084d8c935160caafca9424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Creating volume cf711a1a-55f5-42f9-8794-ae38bf44b3f1 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:19:32 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cf711a1a-55f5-42f9-8794-ae38bf44b3f1 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c790a7-94c1-4474-a611-534611c8e457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:32 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cf711a1a-55f5-42f9-8794-ae38bf44b3f1 1073741824 Sep 01 12:19:32 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a853537-a589-4262-90e2-efc4a9fb6513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:32 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Volume volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 (c5b818f2-fd6e-415f-8d65-f12a5404ea97): created successfully Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a853537-a589-4262-90e2-efc4a9fb6513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Flow 'volume_create_manager' (1f27ecd8-5e57-4215-b3d9-f131a28c1432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:32 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7400fe45-6fa1-4c43-9aa2-0c253a786947 tempest-VolumeDependencyTests-1470079468 None] Created volume successfully. Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Flow 'volume_create_manager' (f523efbb-24c7-4b96-ab21-afd11a773614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1718f08-5360-4f6b-97d3-472f9a304141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1718f08-5360-4f6b-97d3-472f9a304141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1124803867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3fed75f-b8d9-4702-9262-db42dd0079a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab1d5b6771546cda103c5a459be7332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:33Z,use_quota=True,user_id='f8de6acd74084d8c935160caafca9424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8865e96b-b9c5-4148-b58e-642b4a9bbc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8865e96b-b9c5-4148-b58e-642b4a9bbc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f30b78-eb31-4476-b8fe-3ec51586aeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f30b78-eb31-4476-b8fe-3ec51586aeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3fed75f-b8d9-4702-9262-db42dd0079a6', 'volume_name': 'volume-d3fed75f-b8d9-4702-9262-db42dd0079a6', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36514ed6-eeec-4377-832b-bc92c47d0513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36514ed6-eeec-4377-832b-bc92c47d0513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f5d4bd-1295-4b02-a648-1bb7c07641fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:33 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Volume d3fed75f-b8d9-4702-9262-db42dd0079a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3fed75f-b8d9-4702-9262-db42dd0079a6', 'volume_size': 1} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:33 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cf711a1a-55f5-42f9-8794-ae38bf44b3f1 1073741824" returned: 0 in 0.654s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cf711a1a-55f5-42f9-8794-ae38bf44b3f1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:19:33 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cf711a1a-55f5-42f9-8794-ae38bf44b3f1 Sep 01 12:19:33 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Flow 'volume_create_manager' (373f7c7b-3bd6-4e3b-bad4-df5b8994d4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b9f1085-a3cc-46cb-a1c4-a188f0a21f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b9f1085-a3cc-46cb-a1c4-a188f0a21f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-935108022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b56a9f1-18e9-409a-908b-33cb427afad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab1d5b6771546cda103c5a459be7332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:34Z,use_quota=True,user_id='f8de6acd74084d8c935160caafca9424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b16b42f-47c9-4e1b-8fba-da6e38b55846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b16b42f-47c9-4e1b-8fba-da6e38b55846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da70b219-a4a5-40d9-b1a9-37cf9823e3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da70b219-a4a5-40d9-b1a9-37cf9823e3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b56a9f1-18e9-409a-908b-33cb427afad5', 'volume_name': 'volume-9b56a9f1-18e9-409a-908b-33cb427afad5', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeea8262-8bf9-413d-b53f-9f2c63739267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeea8262-8bf9-413d-b53f-9f2c63739267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c42cfc3-104d-4887-a636-81cac54b8f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:33 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Volume 9b56a9f1-18e9-409a-908b-33cb427afad5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b56a9f1-18e9-409a-908b-33cb427afad5', 'volume_size': 1} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:33 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cf711a1a-55f5-42f9-8794-ae38bf44b3f1" returned: 0 in 0.315s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.606s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1124803867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3fed75f-b8d9-4702-9262-db42dd0079a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab1d5b6771546cda103c5a459be7332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:33Z,use_quota=True,user_id='f8de6acd74084d8c935160caafca9424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Creating volume d3fed75f-b8d9-4702-9262-db42dd0079a6 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:19:33 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d3fed75f-b8d9-4702-9262-db42dd0079a6 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73e8459-247f-4867-bfd7-28b6532ef0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf711a1a-55f5-42f9-8794-ae38bf44b3f1', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:33 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d3fed75f-b8d9-4702-9262-db42dd0079a6 1073741824 Sep 01 12:19:33 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c49598-adc6-4335-9464-c60e11286eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:34 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Volume volume-cf711a1a-55f5-42f9-8794-ae38bf44b3f1 (cf711a1a-55f5-42f9-8794-ae38bf44b3f1): created successfully Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c49598-adc6-4335-9464-c60e11286eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Flow 'volume_create_manager' (3a075327-1fe4-41e0-98cd-19f7da4914d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:34 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c526bf38-327d-45a6-b1e4-195616d68119 tempest-CreateVolumesFromImageTest-1578777138 None] Created volume successfully. Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Flow 'volume_create_manager' (2f54326b-713e-42d2-8c7a-e99a4f2e76ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f867840-c62d-420e-8df9-16df7747e8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] Acquiring lock "cinder-4e9e9516-df81-40e9-916e-7bf2adb736af-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0c31b33e-e168-401a-9d2e-4f0c165eba08 tempest-VolumeDependencyTests-1470079468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f867840-c62d-420e-8df9-16df7747e8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-927026484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8f6797-611e-469b-a194-e501e90d4aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab1d5b6771546cda103c5a459be7332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:34Z,use_quota=True,user_id='f8de6acd74084d8c935160caafca9424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565dbea8-d252-4b91-8a07-73b1f4f1874d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565dbea8-d252-4b91-8a07-73b1f4f1874d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220d8fcb-0065-4137-a8cb-a431d29e8612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220d8fcb-0065-4137-a8cb-a431d29e8612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e8f6797-611e-469b-a194-e501e90d4aae', 'volume_name': 'volume-5e8f6797-611e-469b-a194-e501e90d4aae', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0068ebe-37fc-41d1-a03c-6661d3343c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0068ebe-37fc-41d1-a03c-6661d3343c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3aca1a-05e4-4574-86eb-6dc28f202d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:34 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Volume 5e8f6797-611e-469b-a194-e501e90d4aae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e8f6797-611e-469b-a194-e501e90d4aae', 'volume_size': 1} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] Lock "cinder-4e9e9516-df81-40e9-916e-7bf2adb736af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] Acquiring lock "cinder-quobyte-19caa553-8cd6-44f0-aca7-c644af90fc59" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] Lock "cinder-quobyte-19caa553-8cd6-44f0-aca7-c644af90fc59" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] Acquiring lock "cinder-quobyte-4e9e9516-df81-40e9-916e-7bf2adb736af" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] Lock "cinder-quobyte-4e9e9516-df81-40e9-916e-7bf2adb736af" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] Deleting offline snapshot 4e9e9516-df81-40e9-916e-7bf2adb736af of volume 19caa553-8cd6-44f0-aca7-c644af90fc59 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] snapshot_file for this snap is: volume-19caa553-8cd6-44f0-aca7-c644af90fc59.4e9e9516-df81-40e9-916e-7bf2adb736af {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad34c49c-59bf-4770-a33d-d8a6b7dd9c5d]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.4e9e9516-df81-40e9-916e-7bf2adb736af {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:34 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d3fed75f-b8d9-4702-9262-db42dd0079a6 1073741824" returned: 0 in 0.572s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d3fed75f-b8d9-4702-9262-db42dd0079a6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:34 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d3fed75f-b8d9-4702-9262-db42dd0079a6 Sep 01 12:19:34 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:34 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.4e9e9516-df81-40e9-916e-7bf2adb736af Sep 01 12:19:34 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Flow 'volume_create_manager' (a7b114fd-54d5-4923-9fbc-da208ca7ce51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e1552f-3054-4d14-97a2-caee286bc929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e1552f-3054-4d14-97a2-caee286bc929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1878815284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d73d76-ecf6-4228-bbed-6b9d24878e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab1d5b6771546cda103c5a459be7332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:35Z,use_quota=True,user_id='f8de6acd74084d8c935160caafca9424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36a1318-2595-4e2c-a976-05d95a3785b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36a1318-2595-4e2c-a976-05d95a3785b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (595bc3a0-5276-4058-846c-a7a512d99ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (595bc3a0-5276-4058-846c-a7a512d99ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22d73d76-ecf6-4228-bbed-6b9d24878e52', 'volume_name': 'volume-22d73d76-ecf6-4228-bbed-6b9d24878e52', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f824550-1138-43c4-9e2f-baf24957857c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f824550-1138-43c4-9e2f-baf24957857c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (011f3902-eecf-424c-9079-dbd73196cee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:34 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Volume 22d73d76-ecf6-4228-bbed-6b9d24878e52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22d73d76-ecf6-4228-bbed-6b9d24878e52', 'volume_size': 1} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:34 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d3fed75f-b8d9-4702-9262-db42dd0079a6" returned: 0 in 0.279s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.099s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-935108022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b56a9f1-18e9-409a-908b-33cb427afad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab1d5b6771546cda103c5a459be7332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:34Z,use_quota=True,user_id='f8de6acd74084d8c935160caafca9424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Creating volume 9b56a9f1-18e9-409a-908b-33cb427afad5 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:19:34 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9b56a9f1-18e9-409a-908b-33cb427afad5 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f5d4bd-1295-4b02-a648-1bb7c07641fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3fed75f-b8d9-4702-9262-db42dd0079a6', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:34 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9b56a9f1-18e9-409a-908b-33cb427afad5 1073741824 Sep 01 12:19:34 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5afd29-4159-4fee-868b-84f5c250f7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:34 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.4e9e9516-df81-40e9-916e-7bf2adb736af" returned: 0 in 0.421s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19caa553-8cd6-44f0-aca7-c644af90fc59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:19:34 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Volume volume-d3fed75f-b8d9-4702-9262-db42dd0079a6 (d3fed75f-b8d9-4702-9262-db42dd0079a6): created successfully Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5afd29-4159-4fee-868b-84f5c250f7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Flow 'volume_create_manager' (f523efbb-24c7-4b96-ab21-afd11a773614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[450a09dd-8314-48af-af79-c2bd7950ef28]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:34 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5dc87be7-5ea3-452e-9382-619685903b51 tempest-CreateVolumesFromImageTest-1578777138 None] Created volume successfully. Sep 01 12:19:35 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59 Sep 01 12:19:35 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:35 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9b56a9f1-18e9-409a-908b-33cb427afad5 1073741824" returned: 0 in 0.433s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:35 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59" returned: 0 in 0.376s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.4e9e9516-df81-40e9-916e-7bf2adb736af {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:35 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.4e9e9516-df81-40e9-916e-7bf2adb736af Sep 01 12:19:35 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9b56a9f1-18e9-409a-908b-33cb427afad5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:35 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9b56a9f1-18e9-409a-908b-33cb427afad5 Sep 01 12:19:35 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:35 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9b56a9f1-18e9-409a-908b-33cb427afad5" returned: 0 in 0.254s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:19:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0c31b33e-e168-401a-9d2e-4f0c165eba08 tempest-VolumeDependencyTests-1470079468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.292s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-0c31b33e-e168-401a-9d2e-4f0c165eba08 tempest-VolumeDependencyTests-1470079468 None] Creating offline snapshot 2f4717b4-c7eb-4f74-8990-f9ddfd69488e of volume c5b818f2-fd6e-415f-8d65-f12a5404ea97 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:19:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c42cfc3-104d-4887-a636-81cac54b8f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b56a9f1-18e9-409a-908b-33cb427afad5', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d2507c-2750-47ba-8156-facb5a70e356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:35 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95aad57-9cb6-4da7-bd06-2202d420da06]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c31b33e-e168-401a-9d2e-4f0c165eba08 tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:35 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Volume volume-9b56a9f1-18e9-409a-908b-33cb427afad5 (9b56a9f1-18e9-409a-908b-33cb427afad5): created successfully Sep 01 12:19:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d2507c-2750-47ba-8156-facb5a70e356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:35 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Flow 'volume_create_manager' (373f7c7b-3bd6-4e3b-bad4-df5b8994d4d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.4e9e9516-df81-40e9-916e-7bf2adb736af" returned: 0 in 0.393s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.4e9e9516-df81-40e9-916e-7bf2adb736af {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:35 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.4e9e9516-df81-40e9-916e-7bf2adb736af Sep 01 12:19:35 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:35 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-483a9a73-8345-4693-813f-44b72605b780 tempest-CreateVolumesFromImageTest-1578777138 None] Created volume successfully. Sep 01 12:19:35 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 Sep 01 12:19:35 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:35 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59.4e9e9516-df81-40e9-916e-7bf2adb736af" returned: 0 in 0.251s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] Lock "cinder-quobyte-4e9e9516-df81-40e9-916e-7bf2adb736af" released by "_delete_snapshot" :: held 1.566s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] Lock "cinder-quobyte-19caa553-8cd6-44f0-aca7-c644af90fc59" released by "delete_snapshot" :: held 1.593s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:36 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c31b33e-e168-401a-9d2e-4f0c165eba08 tempest-VolumeDependencyTests-1470079468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97" returned: 0 in 0.382s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c31b33e-e168-401a-9d2e-4f0c165eba08 tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:36 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e 1G Sep 01 12:19:36 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:36 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] Created reservations ['88498c4f-8e26-46c1-b3fe-63baf0684a50', 'ee71c9cc-c1f2-4492-b17c-c424831de504', 'd5081667-9aa1-4c5c-82d5-ae0d235896b2', '2ccbb09a-35cf-4c90-9642-d7a59cc7dcb6'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:19:36 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] Delete snapshot completed successfully. Sep 01 12:19:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5170b0e4-76ab-421c-a129-e22eeb69f58e tempest-SnapshotMetadataTestJSON-700512914 None] Lock "cinder-4e9e9516-df81-40e9-916e-7bf2adb736af-delete_snapshot" released by "delete_snapshot" :: held 1.772s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:36 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c31b33e-e168-401a-9d2e-4f0c165eba08 tempest-VolumeDependencyTests-1470079468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e 1G" returned: 0 in 0.403s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c31b33e-e168-401a-9d2e-4f0c165eba08 tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:36 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e Sep 01 12:19:36 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-54ac2a51-87f7-41ab-a43f-777a38644446 tempest-SnapshotMetadataTestJSON-700512914 None] Acquiring lock "cinder-19caa553-8cd6-44f0-aca7-c644af90fc59-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-54ac2a51-87f7-41ab-a43f-777a38644446 tempest-SnapshotMetadataTestJSON-700512914 None] Lock "cinder-19caa553-8cd6-44f0-aca7-c644af90fc59-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-54ac2a51-87f7-41ab-a43f-777a38644446 tempest-SnapshotMetadataTestJSON-700512914 None] Acquiring lock "cinder-quobyte-19caa553-8cd6-44f0-aca7-c644af90fc59" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-54ac2a51-87f7-41ab-a43f-777a38644446 tempest-SnapshotMetadataTestJSON-700512914 None] Lock "cinder-quobyte-19caa553-8cd6-44f0-aca7-c644af90fc59" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:36 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3d52e1-c6a6-48fb-8440-0c695c471b97]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-54ac2a51-87f7-41ab-a43f-777a38644446 tempest-SnapshotMetadataTestJSON-700512914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:36 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c31b33e-e168-401a-9d2e-4f0c165eba08 tempest-VolumeDependencyTests-1470079468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e" returned: 0 in 0.319s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:36 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-0c31b33e-e168-401a-9d2e-4f0c165eba08 tempest-VolumeDependencyTests-1470079468 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e is being set with open permissions: ugo+rw Sep 01 12:19:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c31b33e-e168-401a-9d2e-4f0c165eba08 tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:36 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59 Sep 01 12:19:36 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:36 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e Sep 01 12:19:36 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:37 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c31b33e-e168-401a-9d2e-4f0c165eba08 tempest-VolumeDependencyTests-1470079468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e" returned: 0 in 0.273s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:37 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-54ac2a51-87f7-41ab-a43f-777a38644446 tempest-SnapshotMetadataTestJSON-700512914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59" returned: 0 in 0.419s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-54ac2a51-87f7-41ab-a43f-777a38644446 tempest-SnapshotMetadataTestJSON-700512914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c31b33e-e168-401a-9d2e-4f0c165eba08 tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:37 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59 Sep 01 12:19:37 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:37 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.info Sep 01 12:19:37 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:37 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-54ac2a51-87f7-41ab-a43f-777a38644446 tempest-SnapshotMetadataTestJSON-700512914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-19caa553-8cd6-44f0-aca7-c644af90fc59" returned: 0 in 0.272s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:37 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c31b33e-e168-401a-9d2e-4f0c165eba08 tempest-VolumeDependencyTests-1470079468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.info" returned: 0 in 0.263s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:37 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-0c31b33e-e168-401a-9d2e-4f0c165eba08 tempest-VolumeDependencyTests-1470079468 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.info is being set with open permissions: ugo+rw Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c31b33e-e168-401a-9d2e-4f0c165eba08 tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-54ac2a51-87f7-41ab-a43f-777a38644446 tempest-SnapshotMetadataTestJSON-700512914 None] Lock "cinder-quobyte-19caa553-8cd6-44f0-aca7-c644af90fc59" released by "delete_volume" :: held 0.763s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:37 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.info Sep 01 12:19:37 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-54ac2a51-87f7-41ab-a43f-777a38644446 tempest-SnapshotMetadataTestJSON-700512914 None] Created reservations ['fe610332-8654-4c86-bb6f-38fad824070d', '4e7dfe7b-d840-40f8-8836-bde875740f90', '2349ab57-2dc3-4bb2-9a60-bcc9d8522a65', '019a60d6-e18a-497f-a585-ec67405f8cdd'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-54ac2a51-87f7-41ab-a43f-777a38644446 tempest-SnapshotMetadataTestJSON-700512914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-54ac2a51-87f7-41ab-a43f-777a38644446 tempest-SnapshotMetadataTestJSON-700512914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-54ac2a51-87f7-41ab-a43f-777a38644446 tempest-SnapshotMetadataTestJSON-700512914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-54ac2a51-87f7-41ab-a43f-777a38644446 tempest-SnapshotMetadataTestJSON-700512914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-54ac2a51-87f7-41ab-a43f-777a38644446 tempest-SnapshotMetadataTestJSON-700512914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-54ac2a51-87f7-41ab-a43f-777a38644446 tempest-SnapshotMetadataTestJSON-700512914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:37 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:19:37 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:37 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0c31b33e-e168-401a-9d2e-4f0c165eba08 tempest-VolumeDependencyTests-1470079468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.info" returned: 0 in 0.260s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0c31b33e-e168-401a-9d2e-4f0c165eba08 tempest-VolumeDependencyTests-1470079468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.032s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.280s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-927026484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8f6797-611e-469b-a194-e501e90d4aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab1d5b6771546cda103c5a459be7332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:34Z,use_quota=True,user_id='f8de6acd74084d8c935160caafca9424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Creating volume 5e8f6797-611e-469b-a194-e501e90d4aae {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:19:37 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5e8f6797-611e-469b-a194-e501e90d4aae 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:37 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5e8f6797-611e-469b-a194-e501e90d4aae 1073741824 Sep 01 12:19:37 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0c31b33e-e168-401a-9d2e-4f0c165eba08 tempest-VolumeDependencyTests-1470079468 None] Create snapshot completed successfully Sep 01 12:19:37 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-54ac2a51-87f7-41ab-a43f-777a38644446 tempest-SnapshotMetadataTestJSON-700512914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.308s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-54ac2a51-87f7-41ab-a43f-777a38644446 tempest-SnapshotMetadataTestJSON-700512914 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:19:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-54ac2a51-87f7-41ab-a43f-777a38644446 tempest-SnapshotMetadataTestJSON-700512914 None] Deleted volume successfully. Sep 01 12:19:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-54ac2a51-87f7-41ab-a43f-777a38644446 tempest-SnapshotMetadataTestJSON-700512914 None] Lock "cinder-19caa553-8cd6-44f0-aca7-c644af90fc59-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:38 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5e8f6797-611e-469b-a194-e501e90d4aae 1073741824" returned: 0 in 0.474s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5e8f6797-611e-469b-a194-e501e90d4aae {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:38 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5e8f6797-611e-469b-a194-e501e90d4aae Sep 01 12:19:38 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:38 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5e8f6797-611e-469b-a194-e501e90d4aae" returned: 0 in 0.257s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:19:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.725s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1878815284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d73d76-ecf6-4228-bbed-6b9d24878e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab1d5b6771546cda103c5a459be7332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:35Z,use_quota=True,user_id='f8de6acd74084d8c935160caafca9424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:19:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Creating volume 22d73d76-ecf6-4228-bbed-6b9d24878e52 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:19:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:19:38 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:19:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-22d73d76-ecf6-4228-bbed-6b9d24878e52 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3aca1a-05e4-4574-86eb-6dc28f202d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e8f6797-611e-469b-a194-e501e90d4aae', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c7b307-9424-4680-b2f7-1d24d2dc0397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:38 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Volume volume-5e8f6797-611e-469b-a194-e501e90d4aae (5e8f6797-611e-469b-a194-e501e90d4aae): created successfully Sep 01 12:19:38 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-22d73d76-ecf6-4228-bbed-6b9d24878e52 1073741824 Sep 01 12:19:38 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c7b307-9424-4680-b2f7-1d24d2dc0397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Flow 'volume_create_manager' (2f54326b-713e-42d2-8c7a-e99a4f2e76ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:38 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-28643bda-21b3-49e8-b109-0f09ae0e82cf tempest-CreateVolumesFromImageTest-1578777138 None] Created volume successfully. Sep 01 12:19:39 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-22d73d76-ecf6-4228-bbed-6b9d24878e52 1073741824" returned: 0 in 0.632s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-22d73d76-ecf6-4228-bbed-6b9d24878e52 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:39 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-22d73d76-ecf6-4228-bbed-6b9d24878e52 Sep 01 12:19:39 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Flow 'volume_create_manager' (22cd2345-fb41-4b17-ab3c-21630b672b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34f9476-de55-4130-b043-df8d13514eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34f9476-de55-4130-b043-df8d13514eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-893074684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9663518d-b05e-4a6d-9eab-b9815935c88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019c699980594a7cbd23865d5d9c594f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2f4717b4-c7eb-4f74-8990-f9ddfd69488e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:39Z,use_quota=True,user_id='4f59165f24364e5e9cd66d8f180c3f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8bc68d4-db25-42a1-9108-7ffd5bf5c461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8bc68d4-db25-42a1-9108-7ffd5bf5c461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f908027-f80a-4c3f-ae4b-f43ac72a3f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f908027-f80a-4c3f-ae4b-f43ac72a3f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9663518d-b05e-4a6d-9eab-b9815935c88f', 'volume_name': 'volume-9663518d-b05e-4a6d-9eab-b9815935c88f', 'volume_size': 1, 'snapshot_id': '2f4717b4-c7eb-4f74-8990-f9ddfd69488e'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73977230-35f5-4441-9ca9-e76a566bc533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73977230-35f5-4441-9ca9-e76a566bc533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb648df2-4ade-4867-bd22-7b15d97ac053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Volume 9663518d-b05e-4a6d-9eab-b9815935c88f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9663518d-b05e-4a6d-9eab-b9815935c88f', 'volume_size': 1, 'snapshot_id': '2f4717b4-c7eb-4f74-8990-f9ddfd69488e'} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:39 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-22d73d76-ecf6-4228-bbed-6b9d24878e52" returned: 0 in 0.298s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.094s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Acquiring lock "cinder-quobyte-2f4717b4-c7eb-4f74-8990-f9ddfd69488e-9663518d-b05e-4a6d-9eab-b9815935c88f" by "_create_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (011f3902-eecf-424c-9079-dbd73196cee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d73d76-ecf6-4228-bbed-6b9d24878e52', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8b2120-b846-40db-8fa8-0635eff91e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Lock "cinder-quobyte-2f4717b4-c7eb-4f74-8990-f9ddfd69488e-9663518d-b05e-4a6d-9eab-b9815935c88f" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Creating volume 9663518d-b05e-4a6d-9eab-b9815935c88f from snapshot 2f4717b4-c7eb-4f74-8990-f9ddfd69488e {{(pid=87084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Acquiring lock "cinder-quobyte-9663518d-b05e-4a6d-9eab-b9815935c88f" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Volume volume-22d73d76-ecf6-4228-bbed-6b9d24878e52 (22d73d76-ecf6-4228-bbed-6b9d24878e52): created successfully Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8b2120-b846-40db-8fa8-0635eff91e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Flow 'volume_create_manager' (a7b114fd-54d5-4923-9fbc-da208ca7ce51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Lock "cinder-quobyte-9663518d-b05e-4a6d-9eab-b9815935c88f" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] snapshot: 2f4717b4-c7eb-4f74-8990-f9ddfd69488e, volume: 9663518d-b05e-4a6d-9eab-b9815935c88f, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:19:39 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a65df3ba-81aa-4682-ab9b-3f0bb900e04b tempest-CreateVolumesFromImageTest-1578777138 None] Created volume successfully. Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b23ac3-aea1-4bd5-abc2-21a8213c447d]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:39 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e Sep 01 12:19:39 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:39 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e" returned: 0 in 0.372s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f011d58-2a35-4164-8e33-ce7f246f08b7]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:40 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 Sep 01 12:19:40 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bd3fb4af-5007-4110-ae4a-9f6a13538dfd tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "cinder-22d73d76-ecf6-4228-bbed-6b9d24878e52-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bd3fb4af-5007-4110-ae4a-9f6a13538dfd tempest-CreateVolumesFromImageTest-1578777138 None] Lock "cinder-22d73d76-ecf6-4228-bbed-6b9d24878e52-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bd3fb4af-5007-4110-ae4a-9f6a13538dfd tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "cinder-quobyte-22d73d76-ecf6-4228-bbed-6b9d24878e52" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bd3fb4af-5007-4110-ae4a-9f6a13538dfd tempest-CreateVolumesFromImageTest-1578777138 None] Lock "cinder-quobyte-22d73d76-ecf6-4228-bbed-6b9d24878e52" acquired by "delete_volume" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:40 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7839fc30-7920-4b3f-b9a4-b0232adc7c01]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bd3fb4af-5007-4110-ae4a-9f6a13538dfd tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-22d73d76-ecf6-4228-bbed-6b9d24878e52 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:40 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97" returned: 0 in 0.417s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:19:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:19:40 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Path /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9663518d-b05e-4a6d-9eab-b9815935c88f not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:19:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9663518d-b05e-4a6d-9eab-b9815935c88f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:40 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9663518d-b05e-4a6d-9eab-b9815935c88f Sep 01 12:19:40 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:40 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-22d73d76-ecf6-4228-bbed-6b9d24878e52 Sep 01 12:19:40 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:40 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bd3fb4af-5007-4110-ae4a-9f6a13538dfd tempest-CreateVolumesFromImageTest-1578777138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-22d73d76-ecf6-4228-bbed-6b9d24878e52" returned: 0 in 0.391s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bd3fb4af-5007-4110-ae4a-9f6a13538dfd tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-22d73d76-ecf6-4228-bbed-6b9d24878e52 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:40 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-22d73d76-ecf6-4228-bbed-6b9d24878e52 Sep 01 12:19:40 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:41 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bd3fb4af-5007-4110-ae4a-9f6a13538dfd tempest-CreateVolumesFromImageTest-1578777138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-22d73d76-ecf6-4228-bbed-6b9d24878e52" returned: 0 in 0.346s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bd3fb4af-5007-4110-ae4a-9f6a13538dfd tempest-CreateVolumesFromImageTest-1578777138 None] Lock "cinder-quobyte-22d73d76-ecf6-4228-bbed-6b9d24878e52" released by "delete_volume" :: held 0.812s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-bd3fb4af-5007-4110-ae4a-9f6a13538dfd tempest-CreateVolumesFromImageTest-1578777138 None] Created reservations ['eca371ca-d779-4f25-a912-059ea638b3a3', 'e9191935-4c9c-40bb-9922-5ef7489681b2', '4181d0e6-6e9b-40c8-b6d4-d7e13002aac0', '0c4ff44a-9855-4d59-bb53-962e99b3b490'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bd3fb4af-5007-4110-ae4a-9f6a13538dfd tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bd3fb4af-5007-4110-ae4a-9f6a13538dfd tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-bd3fb4af-5007-4110-ae4a-9f6a13538dfd tempest-CreateVolumesFromImageTest-1578777138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-bd3fb4af-5007-4110-ae4a-9f6a13538dfd tempest-CreateVolumesFromImageTest-1578777138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bd3fb4af-5007-4110-ae4a-9f6a13538dfd tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bd3fb4af-5007-4110-ae4a-9f6a13538dfd tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:41 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:19:41 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0121a616-6359-4ba9-8eba-efedc73e86e4 tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "cinder-5e8f6797-611e-469b-a194-e501e90d4aae-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0121a616-6359-4ba9-8eba-efedc73e86e4 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "cinder-5e8f6797-611e-469b-a194-e501e90d4aae-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0121a616-6359-4ba9-8eba-efedc73e86e4 tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "cinder-quobyte-5e8f6797-611e-469b-a194-e501e90d4aae" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:41 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:19:41 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0121a616-6359-4ba9-8eba-efedc73e86e4 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "cinder-quobyte-5e8f6797-611e-469b-a194-e501e90d4aae" acquired by "delete_volume" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[84be3a17-d378-4336-8cb8-69ef66dfba57]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0121a616-6359-4ba9-8eba-efedc73e86e4 tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5e8f6797-611e-469b-a194-e501e90d4aae {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:42 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5e8f6797-611e-469b-a194-e501e90d4aae Sep 01 12:19:42 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:42 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bd3fb4af-5007-4110-ae4a-9f6a13538dfd tempest-CreateVolumesFromImageTest-1578777138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.784s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-bd3fb4af-5007-4110-ae4a-9f6a13538dfd tempest-CreateVolumesFromImageTest-1578777138 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Flow 'volume_create_manager' (d350b2e9-2bd6-44fa-8085-c24513862c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0576a5e-c601-452e-a577-879e7d4b5ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:42 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-bd3fb4af-5007-4110-ae4a-9f6a13538dfd tempest-CreateVolumesFromImageTest-1578777138 None] Deleted volume successfully. Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0576a5e-c601-452e-a577-879e7d4b5ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1848944489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6758a2-2fa7-460b-8647-89747762ea05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a82d8eb51a41018bfe76e1484a893d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:42Z,use_quota=True,user_id='612f0490d7e24853b05fb5e421fba505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f58f2c4-e419-401a-b6fd-cdd2740dfd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f58f2c4-e419-401a-b6fd-cdd2740dfd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2537344b-958c-4091-9c88-36cccd07ee30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2537344b-958c-4091-9c88-36cccd07ee30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e6758a2-2fa7-460b-8647-89747762ea05', 'volume_name': 'volume-8e6758a2-2fa7-460b-8647-89747762ea05', 'volume_size': 2}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b104354-b3fc-4d44-bd98-401fe72a84c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b104354-b3fc-4d44-bd98-401fe72a84c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (774431f9-d864-4600-8530-08e1289c392e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:42 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Volume 8e6758a2-2fa7-460b-8647-89747762ea05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e6758a2-2fa7-460b-8647-89747762ea05', 'volume_size': 2} Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:42 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.658s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-bd3fb4af-5007-4110-ae4a-9f6a13538dfd tempest-CreateVolumesFromImageTest-1578777138 None] Lock "cinder-22d73d76-ecf6-4228-bbed-6b9d24878e52-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:19:42 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0121a616-6359-4ba9-8eba-efedc73e86e4 tempest-CreateVolumesFromImageTest-1578777138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5e8f6797-611e-469b-a194-e501e90d4aae" returned: 0 in 0.990s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0121a616-6359-4ba9-8eba-efedc73e86e4 tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5e8f6797-611e-469b-a194-e501e90d4aae {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:43 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5e8f6797-611e-469b-a194-e501e90d4aae Sep 01 12:19:43 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:43 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0121a616-6359-4ba9-8eba-efedc73e86e4 tempest-CreateVolumesFromImageTest-1578777138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5e8f6797-611e-469b-a194-e501e90d4aae" returned: 0 in 0.574s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0121a616-6359-4ba9-8eba-efedc73e86e4 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "cinder-quobyte-5e8f6797-611e-469b-a194-e501e90d4aae" released by "delete_volume" :: held 1.694s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:43 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-0121a616-6359-4ba9-8eba-efedc73e86e4 tempest-CreateVolumesFromImageTest-1578777138 None] Created reservations ['b1cef794-40a0-440b-8cbf-977d1bf027de', '09364f39-9a9e-418a-9502-942871898826', 'c4e24476-fa2d-4fd8-9700-80e9f30b8a7c', '620297cd-67b1-4a7f-bc8f-65ee75d61302'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:19:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0121a616-6359-4ba9-8eba-efedc73e86e4 tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0121a616-6359-4ba9-8eba-efedc73e86e4 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0121a616-6359-4ba9-8eba-efedc73e86e4 tempest-CreateVolumesFromImageTest-1578777138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0121a616-6359-4ba9-8eba-efedc73e86e4 tempest-CreateVolumesFromImageTest-1578777138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0121a616-6359-4ba9-8eba-efedc73e86e4 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0121a616-6359-4ba9-8eba-efedc73e86e4 tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:44 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:19:44 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1a685cee-ab34-49b1-8fcc-1a0ac2cb0e82 tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "cinder-9b56a9f1-18e9-409a-908b-33cb427afad5-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1a685cee-ab34-49b1-8fcc-1a0ac2cb0e82 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "cinder-9b56a9f1-18e9-409a-908b-33cb427afad5-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1a685cee-ab34-49b1-8fcc-1a0ac2cb0e82 tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "cinder-quobyte-9b56a9f1-18e9-409a-908b-33cb427afad5" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1a685cee-ab34-49b1-8fcc-1a0ac2cb0e82 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "cinder-quobyte-9b56a9f1-18e9-409a-908b-33cb427afad5" acquired by "delete_volume" :: waited 0.052s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:44 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3424a81-ffc6-405d-8ef4-2003657f24fa]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1a685cee-ab34-49b1-8fcc-1a0ac2cb0e82 tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9b56a9f1-18e9-409a-908b-33cb427afad5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:44 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0121a616-6359-4ba9-8eba-efedc73e86e4 tempest-CreateVolumesFromImageTest-1578777138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.706s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:44 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-0121a616-6359-4ba9-8eba-efedc73e86e4 tempest-CreateVolumesFromImageTest-1578777138 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:19:44 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0121a616-6359-4ba9-8eba-efedc73e86e4 tempest-CreateVolumesFromImageTest-1578777138 None] Deleted volume successfully. Sep 01 12:19:44 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9b56a9f1-18e9-409a-908b-33cb427afad5 Sep 01 12:19:44 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0121a616-6359-4ba9-8eba-efedc73e86e4 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "cinder-5e8f6797-611e-469b-a194-e501e90d4aae-delete_volume" released by "delete_volume" :: held 3.147s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:45 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1a685cee-ab34-49b1-8fcc-1a0ac2cb0e82 tempest-CreateVolumesFromImageTest-1578777138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9b56a9f1-18e9-409a-908b-33cb427afad5" returned: 0 in 0.643s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1a685cee-ab34-49b1-8fcc-1a0ac2cb0e82 tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9b56a9f1-18e9-409a-908b-33cb427afad5 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:45 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9b56a9f1-18e9-409a-908b-33cb427afad5 Sep 01 12:19:45 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:45 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1a685cee-ab34-49b1-8fcc-1a0ac2cb0e82 tempest-CreateVolumesFromImageTest-1578777138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9b56a9f1-18e9-409a-908b-33cb427afad5" returned: 0 in 0.493s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1a685cee-ab34-49b1-8fcc-1a0ac2cb0e82 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "cinder-quobyte-9b56a9f1-18e9-409a-908b-33cb427afad5" released by "delete_volume" :: held 1.259s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:45 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-1a685cee-ab34-49b1-8fcc-1a0ac2cb0e82 tempest-CreateVolumesFromImageTest-1578777138 None] Created reservations ['23c56eb9-5d08-45ae-8648-d2bffe992da0', 'cab46bc2-37eb-4059-b1f0-5c10d3d57c52', 'e130fcaf-b459-481f-bfe5-80f754091953', '1f0fff5b-0816-4a5d-a170-49cc8a92ae38'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:19:45 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9663518d-b05e-4a6d-9eab-b9815935c88f" returned: 0 in 5.453s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:45 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97, size 1024.00 MB, duration 5.45 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9663518d-b05e-4a6d-9eab-b9815935c88f {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:19:45 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Converted 1024.00 MB image at 187.74 MB/s Sep 01 12:19:45 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9663518d-b05e-4a6d-9eab-b9815935c88f is being set with open permissions: ugo+rw Sep 01 12:19:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9663518d-b05e-4a6d-9eab-b9815935c88f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:45 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9663518d-b05e-4a6d-9eab-b9815935c88f Sep 01 12:19:45 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1a685cee-ab34-49b1-8fcc-1a0ac2cb0e82 tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1a685cee-ab34-49b1-8fcc-1a0ac2cb0e82 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1a685cee-ab34-49b1-8fcc-1a0ac2cb0e82 tempest-CreateVolumesFromImageTest-1578777138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1a685cee-ab34-49b1-8fcc-1a0ac2cb0e82 tempest-CreateVolumesFromImageTest-1578777138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1a685cee-ab34-49b1-8fcc-1a0ac2cb0e82 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1a685cee-ab34-49b1-8fcc-1a0ac2cb0e82 tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:45 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:19:45 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:46 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9663518d-b05e-4a6d-9eab-b9815935c88f" returned: 0 in 0.250s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Lock "cinder-quobyte-9663518d-b05e-4a6d-9eab-b9815935c88f" released by "_copy_volume_from_snapshot" :: held 6.582s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:46 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1a685cee-ab34-49b1-8fcc-1a0ac2cb0e82 tempest-CreateVolumesFromImageTest-1578777138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.234s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-1a685cee-ab34-49b1-8fcc-1a0ac2cb0e82 tempest-CreateVolumesFromImageTest-1578777138 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Lock "cinder-quobyte-2f4717b4-c7eb-4f74-8990-f9ddfd69488e-9663518d-b05e-4a6d-9eab-b9815935c88f" released by "_create_volume_from_snapshot" :: held 6.664s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.699s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.642s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1848944489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6758a2-2fa7-460b-8647-89747762ea05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a82d8eb51a41018bfe76e1484a893d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:42Z,use_quota=True,user_id='612f0490d7e24853b05fb5e421fba505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Creating volume 8e6758a2-2fa7-460b-8647-89747762ea05 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:19:46 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05 2147483648 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:46 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1a685cee-ab34-49b1-8fcc-1a0ac2cb0e82 tempest-CreateVolumesFromImageTest-1578777138 None] Deleted volume successfully. Sep 01 12:19:46 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05 2147483648 Sep 01 12:19:46 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb648df2-4ade-4867-bd22-7b15d97ac053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9663518d-b05e-4a6d-9eab-b9815935c88f', 'volume_size': 1, 'snapshot_id': '2f4717b4-c7eb-4f74-8990-f9ddfd69488e'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93798557-dc53-4e15-8589-7cf01cb08abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1a685cee-ab34-49b1-8fcc-1a0ac2cb0e82 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "cinder-9b56a9f1-18e9-409a-908b-33cb427afad5-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:46 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Volume volume-9663518d-b05e-4a6d-9eab-b9815935c88f (9663518d-b05e-4a6d-9eab-b9815935c88f): created successfully Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93798557-dc53-4e15-8589-7cf01cb08abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Flow 'volume_create_manager' (22cd2345-fb41-4b17-ab3c-21630b672b07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:46 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b1ebf1a3-cda8-439a-8acc-3bbe76fc16d9 tempest-VolumeDependencyTests-1470079468 None] Created volume successfully. Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2724c6ec-ce39-4ce4-bde2-03388571c3d6 tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "cinder-d3fed75f-b8d9-4702-9262-db42dd0079a6-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2724c6ec-ce39-4ce4-bde2-03388571c3d6 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "cinder-d3fed75f-b8d9-4702-9262-db42dd0079a6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:46 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05 2147483648" returned: 0 in 0.483s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2724c6ec-ce39-4ce4-bde2-03388571c3d6 tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "cinder-quobyte-d3fed75f-b8d9-4702-9262-db42dd0079a6" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2724c6ec-ce39-4ce4-bde2-03388571c3d6 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "cinder-quobyte-d3fed75f-b8d9-4702-9262-db42dd0079a6" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ed8857-41cb-4fb5-a015-6d294bca9d03]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2724c6ec-ce39-4ce4-bde2-03388571c3d6 tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d3fed75f-b8d9-4702-9262-db42dd0079a6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:46 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05 Sep 01 12:19:46 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:46 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d3fed75f-b8d9-4702-9262-db42dd0079a6 Sep 01 12:19:46 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:46 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05" returned: 0 in 0.257s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (774431f9-d864-4600-8530-08e1289c392e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e6758a2-2fa7-460b-8647-89747762ea05', 'volume_size': 2}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba95fbf-3f78-4400-8701-6008dee2a34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] Acquiring lock "cinder-2f4717b4-c7eb-4f74-8990-f9ddfd69488e-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:46 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Volume volume-8e6758a2-2fa7-460b-8647-89747762ea05 (8e6758a2-2fa7-460b-8647-89747762ea05): created successfully Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba95fbf-3f78-4400-8701-6008dee2a34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Flow 'volume_create_manager' (d350b2e9-2bd6-44fa-8085-c24513862c62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] Lock "cinder-2f4717b4-c7eb-4f74-8990-f9ddfd69488e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] Acquiring lock "cinder-quobyte-c5b818f2-fd6e-415f-8d65-f12a5404ea97" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:46 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9a49b3fa-a89a-4bb0-b33a-337a07ba3948 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Created volume successfully. Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] Lock "cinder-quobyte-c5b818f2-fd6e-415f-8d65-f12a5404ea97" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] Acquiring lock "cinder-quobyte-2f4717b4-c7eb-4f74-8990-f9ddfd69488e" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] Lock "cinder-quobyte-2f4717b4-c7eb-4f74-8990-f9ddfd69488e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] Deleting offline snapshot 2f4717b4-c7eb-4f74-8990-f9ddfd69488e of volume c5b818f2-fd6e-415f-8d65-f12a5404ea97 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:19:47 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] snapshot_file for this snap is: volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2724c6ec-ce39-4ce4-bde2-03388571c3d6 tempest-CreateVolumesFromImageTest-1578777138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d3fed75f-b8d9-4702-9262-db42dd0079a6" returned: 0 in 0.385s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2724c6ec-ce39-4ce4-bde2-03388571c3d6 tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d3fed75f-b8d9-4702-9262-db42dd0079a6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[303f331a-2579-4c86-b011-c931f61a72fd]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:47 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d3fed75f-b8d9-4702-9262-db42dd0079a6 Sep 01 12:19:47 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:47 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e Sep 01 12:19:47 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:47 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2724c6ec-ce39-4ce4-bde2-03388571c3d6 tempest-CreateVolumesFromImageTest-1578777138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d3fed75f-b8d9-4702-9262-db42dd0079a6" returned: 0 in 0.238s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2724c6ec-ce39-4ce4-bde2-03388571c3d6 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "cinder-quobyte-d3fed75f-b8d9-4702-9262-db42dd0079a6" released by "delete_volume" :: held 0.672s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-2724c6ec-ce39-4ce4-bde2-03388571c3d6 tempest-CreateVolumesFromImageTest-1578777138 None] Created reservations ['990733f6-581e-4d8a-83fc-a5f70c68595e', '4675d3c3-445e-42ad-8005-0911527d6ce2', 'eaac0939-ffde-4712-8f17-18091eead467', '005b8e5d-9809-4ca1-84e3-e8635eabe785'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2724c6ec-ce39-4ce4-bde2-03388571c3d6 tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2724c6ec-ce39-4ce4-bde2-03388571c3d6 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2724c6ec-ce39-4ce4-bde2-03388571c3d6 tempest-CreateVolumesFromImageTest-1578777138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2724c6ec-ce39-4ce4-bde2-03388571c3d6 tempest-CreateVolumesFromImageTest-1578777138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2724c6ec-ce39-4ce4-bde2-03388571c3d6 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2724c6ec-ce39-4ce4-bde2-03388571c3d6 tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:47 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e" returned: 0 in 0.374s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:19:47 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:19:47 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c2435e-08e1-4620-9c88-e419d94c00d1]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:47 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 Sep 01 12:19:47 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:47 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2724c6ec-ce39-4ce4-bde2-03388571c3d6 tempest-CreateVolumesFromImageTest-1578777138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.278s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-2724c6ec-ce39-4ce4-bde2-03388571c3d6 tempest-CreateVolumesFromImageTest-1578777138 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:19:47 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2724c6ec-ce39-4ce4-bde2-03388571c3d6 tempest-CreateVolumesFromImageTest-1578777138 None] Deleted volume successfully. Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2724c6ec-ce39-4ce4-bde2-03388571c3d6 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "cinder-d3fed75f-b8d9-4702-9262-db42dd0079a6-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ba1515be-ed82-4ab0-9763-c47bb33f2e62 tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "cinder-cf711a1a-55f5-42f9-8794-ae38bf44b3f1-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ba1515be-ed82-4ab0-9763-c47bb33f2e62 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "cinder-cf711a1a-55f5-42f9-8794-ae38bf44b3f1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-43307ce6-fc6a-43eb-ada6-10ded6fa47d5 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-43307ce6-fc6a-43eb-ada6-10ded6fa47d5 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-43307ce6-fc6a-43eb-ada6-10ded6fa47d5 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Creating offline snapshot 42bf5626-1faa-425a-ada4-ed81cb50b0c1 of volume 8e6758a2-2fa7-460b-8647-89747762ea05 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f67c0a-0eee-4e4b-a6ab-cff582cc765d]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43307ce6-fc6a-43eb-ada6-10ded6fa47d5 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ba1515be-ed82-4ab0-9763-c47bb33f2e62 tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "cinder-quobyte-cf711a1a-55f5-42f9-8794-ae38bf44b3f1" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ba1515be-ed82-4ab0-9763-c47bb33f2e62 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "cinder-quobyte-cf711a1a-55f5-42f9-8794-ae38bf44b3f1" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac30ece-10d7-45a5-95d2-2a5763a4f9a6]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ba1515be-ed82-4ab0-9763-c47bb33f2e62 tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cf711a1a-55f5-42f9-8794-ae38bf44b3f1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:47 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05 Sep 01 12:19:47 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:48 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cf711a1a-55f5-42f9-8794-ae38bf44b3f1 Sep 01 12:19:48 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:48 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97" returned: 0 in 0.659s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:48 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e Sep 01 12:19:48 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:48 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43307ce6-fc6a-43eb-ada6-10ded6fa47d5 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05" returned: 0 in 0.392s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43307ce6-fc6a-43eb-ada6-10ded6fa47d5 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.42bf5626-1faa-425a-ada4-ed81cb50b0c1 2G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:48 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.42bf5626-1faa-425a-ada4-ed81cb50b0c1 2G Sep 01 12:19:48 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:48 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ba1515be-ed82-4ab0-9763-c47bb33f2e62 tempest-CreateVolumesFromImageTest-1578777138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cf711a1a-55f5-42f9-8794-ae38bf44b3f1" returned: 0 in 0.388s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ba1515be-ed82-4ab0-9763-c47bb33f2e62 tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cf711a1a-55f5-42f9-8794-ae38bf44b3f1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:48 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cf711a1a-55f5-42f9-8794-ae38bf44b3f1 Sep 01 12:19:48 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:48 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e" returned: 0 in 0.358s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:48 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e Sep 01 12:19:48 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:48 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ba1515be-ed82-4ab0-9763-c47bb33f2e62 tempest-CreateVolumesFromImageTest-1578777138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cf711a1a-55f5-42f9-8794-ae38bf44b3f1" returned: 0 in 0.280s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ba1515be-ed82-4ab0-9763-c47bb33f2e62 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "cinder-quobyte-cf711a1a-55f5-42f9-8794-ae38bf44b3f1" released by "delete_volume" :: held 0.713s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-ba1515be-ed82-4ab0-9763-c47bb33f2e62 tempest-CreateVolumesFromImageTest-1578777138 None] Created reservations ['73616e4b-72c7-4c6e-832f-1eddfc5a33aa', '0438f0a8-9ef7-4440-b607-9ae0987d229b', '1ddb250b-a88b-438a-8605-348ded037119', '6e7367db-5344-4258-8945-e2afdadd30e9'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:19:48 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43307ce6-fc6a-43eb-ada6-10ded6fa47d5 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.42bf5626-1faa-425a-ada4-ed81cb50b0c1 2G" returned: 0 in 0.448s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43307ce6-fc6a-43eb-ada6-10ded6fa47d5 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e6758a2-2fa7-460b-8647-89747762ea05 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.42bf5626-1faa-425a-ada4-ed81cb50b0c1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:48 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e6758a2-2fa7-460b-8647-89747762ea05 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.42bf5626-1faa-425a-ada4-ed81cb50b0c1 Sep 01 12:19:48 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ba1515be-ed82-4ab0-9763-c47bb33f2e62 tempest-CreateVolumesFromImageTest-1578777138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ba1515be-ed82-4ab0-9763-c47bb33f2e62 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ba1515be-ed82-4ab0-9763-c47bb33f2e62 tempest-CreateVolumesFromImageTest-1578777138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ba1515be-ed82-4ab0-9763-c47bb33f2e62 tempest-CreateVolumesFromImageTest-1578777138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ba1515be-ed82-4ab0-9763-c47bb33f2e62 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ba1515be-ed82-4ab0-9763-c47bb33f2e62 tempest-CreateVolumesFromImageTest-1578777138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:48 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:19:48 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:48 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97.2f4717b4-c7eb-4f74-8990-f9ddfd69488e" returned: 0 in 0.286s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] Lock "cinder-quobyte-2f4717b4-c7eb-4f74-8990-f9ddfd69488e" released by "_delete_snapshot" :: held 1.800s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] Lock "cinder-quobyte-c5b818f2-fd6e-415f-8d65-f12a5404ea97" released by "delete_snapshot" :: held 1.827s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:48 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] Created reservations ['0333e4b3-46c3-4ec3-a1f5-4abadc7d8536', '6086842b-2e1b-4ae2-996e-6d28e36ee58d', 'e48219ef-6d1f-4016-8dc2-217df8773a49', '1e38ad95-d1ab-4c4a-a4bc-13a34ff939a6'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:19:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] Delete snapshot completed successfully. Sep 01 12:19:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-60352b1a-5212-475a-9365-377a98013e3c tempest-VolumeDependencyTests-1470079468 None] Lock "cinder-2f4717b4-c7eb-4f74-8990-f9ddfd69488e-delete_snapshot" released by "delete_snapshot" :: held 2.006s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:49 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ba1515be-ed82-4ab0-9763-c47bb33f2e62 tempest-CreateVolumesFromImageTest-1578777138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.330s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:49 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-ba1515be-ed82-4ab0-9763-c47bb33f2e62 tempest-CreateVolumesFromImageTest-1578777138 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:19:49 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:49 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ba1515be-ed82-4ab0-9763-c47bb33f2e62 tempest-CreateVolumesFromImageTest-1578777138 None] Deleted volume successfully. Sep 01 12:19:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43307ce6-fc6a-43eb-ada6-10ded6fa47d5 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e6758a2-2fa7-460b-8647-89747762ea05 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.42bf5626-1faa-425a-ada4-ed81cb50b0c1" returned: 0 in 0.388s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:49 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-43307ce6-fc6a-43eb-ada6-10ded6fa47d5 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.42bf5626-1faa-425a-ada4-ed81cb50b0c1 is being set with open permissions: ugo+rw Sep 01 12:19:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43307ce6-fc6a-43eb-ada6-10ded6fa47d5 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.42bf5626-1faa-425a-ada4-ed81cb50b0c1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ba1515be-ed82-4ab0-9763-c47bb33f2e62 tempest-CreateVolumesFromImageTest-1578777138 None] Lock "cinder-cf711a1a-55f5-42f9-8794-ae38bf44b3f1-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:49 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.42bf5626-1faa-425a-ada4-ed81cb50b0c1 Sep 01 12:19:49 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0a5555d0-53f2-48ff-8dba-4cd4bea870e9 tempest-VolumeDependencyTests-1470079468 None] Acquiring lock "cinder-c5b818f2-fd6e-415f-8d65-f12a5404ea97-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0a5555d0-53f2-48ff-8dba-4cd4bea870e9 tempest-VolumeDependencyTests-1470079468 None] Lock "cinder-c5b818f2-fd6e-415f-8d65-f12a5404ea97-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0a5555d0-53f2-48ff-8dba-4cd4bea870e9 tempest-VolumeDependencyTests-1470079468 None] Acquiring lock "cinder-quobyte-c5b818f2-fd6e-415f-8d65-f12a5404ea97" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0a5555d0-53f2-48ff-8dba-4cd4bea870e9 tempest-VolumeDependencyTests-1470079468 None] Lock "cinder-quobyte-c5b818f2-fd6e-415f-8d65-f12a5404ea97" acquired by "delete_volume" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:49 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b6739a-c55d-422b-96c3-df1462f7deaf]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0a5555d0-53f2-48ff-8dba-4cd4bea870e9 tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:49 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 Sep 01 12:19:49 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:49 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43307ce6-fc6a-43eb-ada6-10ded6fa47d5 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.42bf5626-1faa-425a-ada4-ed81cb50b0c1" returned: 0 in 0.312s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43307ce6-fc6a-43eb-ada6-10ded6fa47d5 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:49 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.info Sep 01 12:19:49 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:49 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0a5555d0-53f2-48ff-8dba-4cd4bea870e9 tempest-VolumeDependencyTests-1470079468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97" returned: 0 in 0.401s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0a5555d0-53f2-48ff-8dba-4cd4bea870e9 tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:49 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97 Sep 01 12:19:49 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:49 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43307ce6-fc6a-43eb-ada6-10ded6fa47d5 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.info" returned: 0 in 0.275s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:49 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-43307ce6-fc6a-43eb-ada6-10ded6fa47d5 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.info is being set with open permissions: ugo+rw Sep 01 12:19:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43307ce6-fc6a-43eb-ada6-10ded6fa47d5 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:49 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.info Sep 01 12:19:49 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:49 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0a5555d0-53f2-48ff-8dba-4cd4bea870e9 tempest-VolumeDependencyTests-1470079468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c5b818f2-fd6e-415f-8d65-f12a5404ea97" returned: 0 in 0.294s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:49 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0a5555d0-53f2-48ff-8dba-4cd4bea870e9 tempest-VolumeDependencyTests-1470079468 None] Lock "cinder-quobyte-c5b818f2-fd6e-415f-8d65-f12a5404ea97" released by "delete_volume" :: held 0.777s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-43307ce6-fc6a-43eb-ada6-10ded6fa47d5 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.info" returned: 0 in 0.282s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-43307ce6-fc6a-43eb-ada6-10ded6fa47d5 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.198s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:50 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-43307ce6-fc6a-43eb-ada6-10ded6fa47d5 tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Create snapshot completed successfully Sep 01 12:19:50 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-0a5555d0-53f2-48ff-8dba-4cd4bea870e9 tempest-VolumeDependencyTests-1470079468 None] Created reservations ['f50e6f03-f1b3-44b9-b02d-a4bdb029c4aa', '68b78f9d-6f96-45b0-8e9f-e41d15b9286b', 'd8519398-acf1-459c-bbd8-36d8cc18df72', '4a92b1f2-9090-402d-9b7f-cd8fd62c1ca1'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:19:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0a5555d0-53f2-48ff-8dba-4cd4bea870e9 tempest-VolumeDependencyTests-1470079468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0a5555d0-53f2-48ff-8dba-4cd4bea870e9 tempest-VolumeDependencyTests-1470079468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0a5555d0-53f2-48ff-8dba-4cd4bea870e9 tempest-VolumeDependencyTests-1470079468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0a5555d0-53f2-48ff-8dba-4cd4bea870e9 tempest-VolumeDependencyTests-1470079468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0a5555d0-53f2-48ff-8dba-4cd4bea870e9 tempest-VolumeDependencyTests-1470079468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0a5555d0-53f2-48ff-8dba-4cd4bea870e9 tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:50 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:19:50 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2ac75e9f-813c-404e-8318-e50a28bfbaa1 tempest-VolumeDependencyTests-1470079468 None] Acquiring lock "cinder-9663518d-b05e-4a6d-9eab-b9815935c88f-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2ac75e9f-813c-404e-8318-e50a28bfbaa1 tempest-VolumeDependencyTests-1470079468 None] Lock "cinder-9663518d-b05e-4a6d-9eab-b9815935c88f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:50 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2ac75e9f-813c-404e-8318-e50a28bfbaa1 tempest-VolumeDependencyTests-1470079468 None] Acquiring lock "cinder-quobyte-9663518d-b05e-4a6d-9eab-b9815935c88f" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0a5555d0-53f2-48ff-8dba-4cd4bea870e9 tempest-VolumeDependencyTests-1470079468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.284s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:50 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-0a5555d0-53f2-48ff-8dba-4cd4bea870e9 tempest-VolumeDependencyTests-1470079468 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:19:50 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0a5555d0-53f2-48ff-8dba-4cd4bea870e9 tempest-VolumeDependencyTests-1470079468 None] Deleted volume successfully. Sep 01 12:19:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2ac75e9f-813c-404e-8318-e50a28bfbaa1 tempest-VolumeDependencyTests-1470079468 None] Lock "cinder-quobyte-9663518d-b05e-4a6d-9eab-b9815935c88f" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:50 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c79c94f-1827-4415-bba8-212f2a863160]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ac75e9f-813c-404e-8318-e50a28bfbaa1 tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9663518d-b05e-4a6d-9eab-b9815935c88f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0a5555d0-53f2-48ff-8dba-4cd4bea870e9 tempest-VolumeDependencyTests-1470079468 None] Lock "cinder-c5b818f2-fd6e-415f-8d65-f12a5404ea97-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:50 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9663518d-b05e-4a6d-9eab-b9815935c88f Sep 01 12:19:50 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:50 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ac75e9f-813c-404e-8318-e50a28bfbaa1 tempest-VolumeDependencyTests-1470079468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9663518d-b05e-4a6d-9eab-b9815935c88f" returned: 0 in 0.401s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ac75e9f-813c-404e-8318-e50a28bfbaa1 tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9663518d-b05e-4a6d-9eab-b9815935c88f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:50 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9663518d-b05e-4a6d-9eab-b9815935c88f Sep 01 12:19:50 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Acquiring lock "cinder-42bf5626-1faa-425a-ada4-ed81cb50b0c1-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Lock "cinder-42bf5626-1faa-425a-ada4-ed81cb50b0c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Acquiring lock "cinder-quobyte-8e6758a2-2fa7-460b-8647-89747762ea05" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Lock "cinder-quobyte-8e6758a2-2fa7-460b-8647-89747762ea05" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Acquiring lock "cinder-quobyte-42bf5626-1faa-425a-ada4-ed81cb50b0c1" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Lock "cinder-quobyte-42bf5626-1faa-425a-ada4-ed81cb50b0c1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Deleting offline snapshot 42bf5626-1faa-425a-ada4-ed81cb50b0c1 of volume 8e6758a2-2fa7-460b-8647-89747762ea05 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] snapshot_file for this snap is: volume-8e6758a2-2fa7-460b-8647-89747762ea05.42bf5626-1faa-425a-ada4-ed81cb50b0c1 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:19:51 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ac75e9f-813c-404e-8318-e50a28bfbaa1 tempest-VolumeDependencyTests-1470079468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9663518d-b05e-4a6d-9eab-b9815935c88f" returned: 0 in 0.308s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f46047-291f-4b70-acda-4c42b33fc949]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.42bf5626-1faa-425a-ada4-ed81cb50b0c1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2ac75e9f-813c-404e-8318-e50a28bfbaa1 tempest-VolumeDependencyTests-1470079468 None] Lock "cinder-quobyte-9663518d-b05e-4a6d-9eab-b9815935c88f" released by "delete_volume" :: held 0.758s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-2ac75e9f-813c-404e-8318-e50a28bfbaa1 tempest-VolumeDependencyTests-1470079468 None] Created reservations ['e6c973d7-91ec-48d4-bf78-66939f31eed2', '83be7f8c-88a3-4223-87dd-68716d2f253f', '62117db2-9137-418f-9441-a9ac12d8858a', '852a65c3-0dc9-4b47-acd2-2200bf7df04a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:19:51 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.42bf5626-1faa-425a-ada4-ed81cb50b0c1 Sep 01 12:19:51 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2ac75e9f-813c-404e-8318-e50a28bfbaa1 tempest-VolumeDependencyTests-1470079468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2ac75e9f-813c-404e-8318-e50a28bfbaa1 tempest-VolumeDependencyTests-1470079468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2ac75e9f-813c-404e-8318-e50a28bfbaa1 tempest-VolumeDependencyTests-1470079468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2ac75e9f-813c-404e-8318-e50a28bfbaa1 tempest-VolumeDependencyTests-1470079468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2ac75e9f-813c-404e-8318-e50a28bfbaa1 tempest-VolumeDependencyTests-1470079468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ac75e9f-813c-404e-8318-e50a28bfbaa1 tempest-VolumeDependencyTests-1470079468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:51 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:19:51 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:51 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:51 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ac75e9f-813c-404e-8318-e50a28bfbaa1 tempest-VolumeDependencyTests-1470079468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.293s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-2ac75e9f-813c-404e-8318-e50a28bfbaa1 tempest-VolumeDependencyTests-1470079468 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.42bf5626-1faa-425a-ada4-ed81cb50b0c1" returned: 0 in 0.448s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e6758a2-2fa7-460b-8647-89747762ea05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:19:51 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2ac75e9f-813c-404e-8318-e50a28bfbaa1 tempest-VolumeDependencyTests-1470079468 None] Deleted volume successfully. Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b3a947-e14d-42cf-8c1f-bd8fe6f3ac9e]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2ac75e9f-813c-404e-8318-e50a28bfbaa1 tempest-VolumeDependencyTests-1470079468 None] Lock "cinder-9663518d-b05e-4a6d-9eab-b9815935c88f-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:51 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05 Sep 01 12:19:51 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:52 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05" returned: 0 in 0.388s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.42bf5626-1faa-425a-ada4-ed81cb50b0c1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:52 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.42bf5626-1faa-425a-ada4-ed81cb50b0c1 Sep 01 12:19:52 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Flow 'volume_create_manager' (1e86c782-2546-401f-add9-78899d7ffc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ebb8ec8-2005-4513-8b07-23105855809e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ebb8ec8-2005-4513-8b07-23105855809e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1586550228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f010d1-cd2f-4f48-943f-0d4afe495868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0322c1aec44fae9aefdcd96e748a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:52Z,use_quota=True,user_id='e28fcf3523a44c7e990763659603d924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95776f33-513f-4ffc-997c-fa7cc10bea3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95776f33-513f-4ffc-997c-fa7cc10bea3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (911650fb-462e-4d7c-84bc-f88ceb6396da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:52 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (911650fb-462e-4d7c-84bc-f88ceb6396da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89f010d1-cd2f-4f48-943f-0d4afe495868', 'volume_name': 'volume-89f010d1-cd2f-4f48-943f-0d4afe495868', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (236fa8f5-0689-4cde-bf5f-86deaf3fb6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (236fa8f5-0689-4cde-bf5f-86deaf3fb6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce4836e2-6fe6-4669-9e4d-b89f8eaa7741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:52 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Volume 89f010d1-cd2f-4f48-943f-0d4afe495868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89f010d1-cd2f-4f48-943f-0d4afe495868', 'volume_size': 1} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1586550228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f010d1-cd2f-4f48-943f-0d4afe495868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0322c1aec44fae9aefdcd96e748a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:52Z,use_quota=True,user_id='e28fcf3523a44c7e990763659603d924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Creating volume 89f010d1-cd2f-4f48-943f-0d4afe495868 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:19:52 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.42bf5626-1faa-425a-ada4-ed81cb50b0c1" returned: 0 in 0.456s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.42bf5626-1faa-425a-ada4-ed81cb50b0c1 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:52 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868 1073741824 Sep 01 12:19:52 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:52 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.42bf5626-1faa-425a-ada4-ed81cb50b0c1 Sep 01 12:19:52 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:52 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05.42bf5626-1faa-425a-ada4-ed81cb50b0c1" returned: 0 in 0.271s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Lock "cinder-quobyte-42bf5626-1faa-425a-ada4-ed81cb50b0c1" released by "_delete_snapshot" :: held 1.693s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Lock "cinder-quobyte-8e6758a2-2fa7-460b-8647-89747762ea05" released by "delete_snapshot" :: held 1.720s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Created reservations ['754c8601-9b56-499f-b0c8-234643e53cbe', 'f849bfa3-93fc-4cd5-99af-8d7a0c5eb62a', 'b2e1d40b-4d19-4e3d-9356-c5b450384b66', 'de95958f-6a81-4c90-9360-97c76547bfa6'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:19:52 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Delete snapshot completed successfully. Sep 01 12:19:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aeecbcfd-aa13-4d9f-b195-f5d20551b87d tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Lock "cinder-42bf5626-1faa-425a-ada4-ed81cb50b0c1-delete_snapshot" released by "delete_snapshot" :: held 1.876s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:53 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868 1073741824" returned: 0 in 0.492s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:53 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868 Sep 01 12:19:53 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c5ec02f9-51a7-45a4-a4c1-ed0dd6668bfe tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Acquiring lock "cinder-8e6758a2-2fa7-460b-8647-89747762ea05-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:53 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868" returned: 0 in 0.292s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:19:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c5ec02f9-51a7-45a4-a4c1-ed0dd6668bfe tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Lock "cinder-8e6758a2-2fa7-460b-8647-89747762ea05-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce4836e2-6fe6-4669-9e4d-b89f8eaa7741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89f010d1-cd2f-4f48-943f-0d4afe495868', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db66821-7305-4884-a169-13008b1650fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:53 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Volume volume-89f010d1-cd2f-4f48-943f-0d4afe495868 (89f010d1-cd2f-4f48-943f-0d4afe495868): created successfully Sep 01 12:19:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db66821-7305-4884-a169-13008b1650fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Flow 'volume_create_manager' (1e86c782-2546-401f-add9-78899d7ffc67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c5ec02f9-51a7-45a4-a4c1-ed0dd6668bfe tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Acquiring lock "cinder-quobyte-8e6758a2-2fa7-460b-8647-89747762ea05" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:19:53 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8f424085-61fd-426f-a99c-0b866aa3e57b tempest-CreateVolumesFromSnapshotTest-455330224 None] Created volume successfully. Sep 01 12:19:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c5ec02f9-51a7-45a4-a4c1-ed0dd6668bfe tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Lock "cinder-quobyte-8e6758a2-2fa7-460b-8647-89747762ea05" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:19:53 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bed765-8918-45e3-8da1-9e43f3a252ba]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5ec02f9-51a7-45a4-a4c1-ed0dd6668bfe tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:53 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05 Sep 01 12:19:53 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:53 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5ec02f9-51a7-45a4-a4c1-ed0dd6668bfe tempest-VolumesSnapshotNegativeTestJSON-195932588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05" returned: 0 in 0.380s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5ec02f9-51a7-45a4-a4c1-ed0dd6668bfe tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:53 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05 Sep 01 12:19:53 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:54 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5ec02f9-51a7-45a4-a4c1-ed0dd6668bfe tempest-VolumesSnapshotNegativeTestJSON-195932588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8e6758a2-2fa7-460b-8647-89747762ea05" returned: 0 in 0.247s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c5ec02f9-51a7-45a4-a4c1-ed0dd6668bfe tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Lock "cinder-quobyte-8e6758a2-2fa7-460b-8647-89747762ea05" released by "delete_volume" :: held 0.687s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:54 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c5ec02f9-51a7-45a4-a4c1-ed0dd6668bfe tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Created reservations ['3c9f5850-21be-41ea-ba40-f5cfd666f8cc', 'd7d8fa0f-f58e-4484-be68-66a47b2d47e1', '2cbe8050-2760-490c-88f5-7a162f12dbe6', 'fe8f32d3-b8ea-4a69-aa13-d89ab256e39e'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:19:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5ec02f9-51a7-45a4-a4c1-ed0dd6668bfe tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5ec02f9-51a7-45a4-a4c1-ed0dd6668bfe tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c5ec02f9-51a7-45a4-a4c1-ed0dd6668bfe tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c5ec02f9-51a7-45a4-a4c1-ed0dd6668bfe tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5ec02f9-51a7-45a4-a4c1-ed0dd6668bfe tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5ec02f9-51a7-45a4-a4c1-ed0dd6668bfe tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:54 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:19:54 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:54 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5ec02f9-51a7-45a4-a4c1-ed0dd6668bfe tempest-VolumesSnapshotNegativeTestJSON-195932588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.254s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:54 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c5ec02f9-51a7-45a4-a4c1-ed0dd6668bfe tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:19:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c5ec02f9-51a7-45a4-a4c1-ed0dd6668bfe tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Deleted volume successfully. Sep 01 12:19:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c5ec02f9-51a7-45a4-a4c1-ed0dd6668bfe tempest-VolumesSnapshotNegativeTestJSON-195932588 None] Lock "cinder-8e6758a2-2fa7-460b-8647-89747762ea05-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:19:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bdd5798c-3a8f-453b-b27f-d4a0c877d990 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bdd5798c-3a8f-453b-b27f-d4a0c877d990 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-bdd5798c-3a8f-453b-b27f-d4a0c877d990 tempest-CreateVolumesFromSnapshotTest-455330224 None] Creating offline snapshot 314e4548-dda5-4c34-a26a-0b1a08dd17a9 of volume 89f010d1-cd2f-4f48-943f-0d4afe495868 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:19:54 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1355e2c-8997-43a4-b747-d5197020d92d]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:19:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bdd5798c-3a8f-453b-b27f-d4a0c877d990 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:54 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868 Sep 01 12:19:54 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:55 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bdd5798c-3a8f-453b-b27f-d4a0c877d990 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868" returned: 0 in 0.410s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bdd5798c-3a8f-453b-b27f-d4a0c877d990 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.314e4548-dda5-4c34-a26a-0b1a08dd17a9 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:55 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.314e4548-dda5-4c34-a26a-0b1a08dd17a9 1G Sep 01 12:19:55 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:55 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bdd5798c-3a8f-453b-b27f-d4a0c877d990 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.314e4548-dda5-4c34-a26a-0b1a08dd17a9 1G" returned: 0 in 0.463s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bdd5798c-3a8f-453b-b27f-d4a0c877d990 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89f010d1-cd2f-4f48-943f-0d4afe495868 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.314e4548-dda5-4c34-a26a-0b1a08dd17a9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:55 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89f010d1-cd2f-4f48-943f-0d4afe495868 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.314e4548-dda5-4c34-a26a-0b1a08dd17a9 Sep 01 12:19:55 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:55 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bdd5798c-3a8f-453b-b27f-d4a0c877d990 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89f010d1-cd2f-4f48-943f-0d4afe495868 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.314e4548-dda5-4c34-a26a-0b1a08dd17a9" returned: 0 in 0.356s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:55 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-bdd5798c-3a8f-453b-b27f-d4a0c877d990 tempest-CreateVolumesFromSnapshotTest-455330224 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.314e4548-dda5-4c34-a26a-0b1a08dd17a9 is being set with open permissions: ugo+rw Sep 01 12:19:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bdd5798c-3a8f-453b-b27f-d4a0c877d990 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.314e4548-dda5-4c34-a26a-0b1a08dd17a9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:55 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.314e4548-dda5-4c34-a26a-0b1a08dd17a9 Sep 01 12:19:55 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:56 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bdd5798c-3a8f-453b-b27f-d4a0c877d990 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.314e4548-dda5-4c34-a26a-0b1a08dd17a9" returned: 0 in 0.302s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bdd5798c-3a8f-453b-b27f-d4a0c877d990 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:56 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.info Sep 01 12:19:56 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:56 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bdd5798c-3a8f-453b-b27f-d4a0c877d990 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.info" returned: 0 in 0.267s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:56 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-bdd5798c-3a8f-453b-b27f-d4a0c877d990 tempest-CreateVolumesFromSnapshotTest-455330224 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.info is being set with open permissions: ugo+rw Sep 01 12:19:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bdd5798c-3a8f-453b-b27f-d4a0c877d990 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:56 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.info Sep 01 12:19:56 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:56 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-bdd5798c-3a8f-453b-b27f-d4a0c877d990 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.info" returned: 0 in 0.271s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-bdd5798c-3a8f-453b-b27f-d4a0c877d990 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.167s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:56 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-bdd5798c-3a8f-453b-b27f-d4a0c877d990 tempest-CreateVolumesFromSnapshotTest-455330224 None] Create snapshot completed successfully Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Flow 'volume_create_manager' (ac30dd7a-1e3d-40bc-900b-c5626ffd06c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d3b883-bd11-4b12-ad3c-2f3edebfe117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d3b883-bd11-4b12-ad3c-2f3edebfe117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-545534587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78073955-60dd-46eb-91bc-09b0e745097c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0322c1aec44fae9aefdcd96e748a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:58Z,use_quota=True,user_id='e28fcf3523a44c7e990763659603d924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221ebc92-ccaa-4c32-aa45-f9299732064e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221ebc92-ccaa-4c32-aa45-f9299732064e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d252d21f-465b-483e-adb6-89e368d4ec2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d252d21f-465b-483e-adb6-89e368d4ec2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78073955-60dd-46eb-91bc-09b0e745097c', 'volume_name': 'volume-78073955-60dd-46eb-91bc-09b0e745097c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d398dd0-071b-4828-8e47-de6c7aa1a4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d398dd0-071b-4828-8e47-de6c7aa1a4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec63a8b-6d6e-44cb-a756-a635a7ec2ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:58 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Volume 78073955-60dd-46eb-91bc-09b0e745097c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78073955-60dd-46eb-91bc-09b0e745097c', 'volume_size': 1} Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-545534587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78073955-60dd-46eb-91bc-09b0e745097c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0322c1aec44fae9aefdcd96e748a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:58Z,use_quota=True,user_id='e28fcf3523a44c7e990763659603d924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Creating volume 78073955-60dd-46eb-91bc-09b0e745097c {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:19:58 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:19:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-78073955-60dd-46eb-91bc-09b0e745097c 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:58 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-78073955-60dd-46eb-91bc-09b0e745097c 1073741824 Sep 01 12:19:58 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Flow 'volume_create_manager' (9ec22107-a90f-4241-aaa7-a71660c341ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135d280a-6d06-45b5-8449-040a9a93ef08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135d280a-6d06-45b5-8449-040a9a93ef08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-152676542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7c671b-a023-4681-b01e-59f3f3b42887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0322c1aec44fae9aefdcd96e748a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:59Z,use_quota=True,user_id='e28fcf3523a44c7e990763659603d924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c90ecdc-8daf-4d73-90c6-ae61d9aade21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c90ecdc-8daf-4d73-90c6-ae61d9aade21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebac4069-075e-4ffe-8297-a95d3b2998a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebac4069-075e-4ffe-8297-a95d3b2998a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae7c671b-a023-4681-b01e-59f3f3b42887', 'volume_name': 'volume-ae7c671b-a023-4681-b01e-59f3f3b42887', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2715913b-b637-4408-b37a-229b3b254e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2715913b-b637-4408-b37a-229b3b254e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9df6d17-1fa7-4c34-809a-24737860c05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:59 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Volume ae7c671b-a023-4681-b01e-59f3f3b42887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae7c671b-a023-4681-b01e-59f3f3b42887', 'volume_size': 1} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:59 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-78073955-60dd-46eb-91bc-09b0e745097c 1073741824" returned: 0 in 0.611s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-78073955-60dd-46eb-91bc-09b0e745097c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:59 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-78073955-60dd-46eb-91bc-09b0e745097c Sep 01 12:19:59 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:59 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-78073955-60dd-46eb-91bc-09b0e745097c" returned: 0 in 0.307s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.397s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-152676542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7c671b-a023-4681-b01e-59f3f3b42887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0322c1aec44fae9aefdcd96e748a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:19:59Z,use_quota=True,user_id='e28fcf3523a44c7e990763659603d924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Creating volume ae7c671b-a023-4681-b01e-59f3f3b42887 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:19:59 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ae7c671b-a023-4681-b01e-59f3f3b42887 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:19:59 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ae7c671b-a023-4681-b01e-59f3f3b42887 1073741824 Sep 01 12:19:59 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec63a8b-6d6e-44cb-a756-a635a7ec2ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78073955-60dd-46eb-91bc-09b0e745097c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d26ccc9-b622-4dd4-9ff8-13095bcaf0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:59 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Volume volume-78073955-60dd-46eb-91bc-09b0e745097c (78073955-60dd-46eb-91bc-09b0e745097c): created successfully Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d26ccc9-b622-4dd4-9ff8-13095bcaf0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Flow 'volume_create_manager' (ac30dd7a-1e3d-40bc-900b-c5626ffd06c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Flow 'volume_create_manager' (61983e9e-0bcf-4a94-9924-2f4ca35ff4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e032965b-6612-4742-8701-be53950ca8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:59 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5a85b088-b967-4c02-93cf-a747b072205a tempest-CreateVolumesFromSnapshotTest-455330224 None] Created volume successfully. Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e032965b-6612-4742-8701-be53950ca8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-393804106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b3273d-ccb0-4e76-97c0-803a4f08adff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0322c1aec44fae9aefdcd96e748a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:20:00Z,use_quota=True,user_id='e28fcf3523a44c7e990763659603d924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7208af6-5eed-4f8a-a60b-959ed49c27be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7208af6-5eed-4f8a-a60b-959ed49c27be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ffc1f40-5f36-4465-8451-d8ff4637e839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ffc1f40-5f36-4465-8451-d8ff4637e839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b3273d-ccb0-4e76-97c0-803a4f08adff', 'volume_name': 'volume-c7b3273d-ccb0-4e76-97c0-803a4f08adff', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c950c1e8-59b5-4495-928f-402b9cf9427d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c950c1e8-59b5-4495-928f-402b9cf9427d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf36d71-1f2b-4ab1-b51b-3bb39cef1f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:19:59 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Volume c7b3273d-ccb0-4e76-97c0-803a4f08adff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b3273d-ccb0-4e76-97c0-803a4f08adff', 'volume_size': 1} Sep 01 12:19:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Flow 'volume_create_manager' (0a6ec275-dcb0-4647-b931-ff590afa1d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d75ffb3-2240-4939-a604-567284a170f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d75ffb3-2240-4939-a604-567284a170f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1669067424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed15201e-d7ec-4639-a7d3-c66b175a344a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0322c1aec44fae9aefdcd96e748a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:20:00Z,use_quota=True,user_id='e28fcf3523a44c7e990763659603d924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ac2c6f-726c-4278-8722-1734d9fb6307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ac2c6f-726c-4278-8722-1734d9fb6307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:00 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d39160c8-7372-46b6-afeb-e5efc7695b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d39160c8-7372-46b6-afeb-e5efc7695b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed15201e-d7ec-4639-a7d3-c66b175a344a', 'volume_name': 'volume-ed15201e-d7ec-4639-a7d3-c66b175a344a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825c31c7-d7a3-4976-9adf-e88eaaf79efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825c31c7-d7a3-4976-9adf-e88eaaf79efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfa0c34-a864-40b1-bb03-176a4776dfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:00 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Volume ed15201e-d7ec-4639-a7d3-c66b175a344a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed15201e-d7ec-4639-a7d3-c66b175a344a', 'volume_size': 1} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ae7c671b-a023-4681-b01e-59f3f3b42887 1073741824" returned: 0 in 0.676s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ae7c671b-a023-4681-b01e-59f3f3b42887 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:00 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ae7c671b-a023-4681-b01e-59f3f3b42887 Sep 01 12:20:00 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Flow 'volume_create_manager' (6c9aad19-2ebc-48e1-b70a-602d1b593344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9ea63e-760a-4762-aa2a-aae50a3b8786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9ea63e-760a-4762-aa2a-aae50a3b8786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-788579894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080453ef-ad9e-4336-9620-d07ac181a6b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0322c1aec44fae9aefdcd96e748a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:20:01Z,use_quota=True,user_id='e28fcf3523a44c7e990763659603d924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47d4bd4-16f2-4736-9cbb-0d2b49823c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47d4bd4-16f2-4736-9cbb-0d2b49823c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f83eb7-bace-479c-a9ac-afb708eceda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f83eb7-bace-479c-a9ac-afb708eceda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '080453ef-ad9e-4336-9620-d07ac181a6b0', 'volume_name': 'volume-080453ef-ad9e-4336-9620-d07ac181a6b0', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8684b416-93b0-40a0-bdb1-f571c3a5cb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8684b416-93b0-40a0-bdb1-f571c3a5cb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be789cab-c671-47e6-a694-9f670f2869ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:00 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Volume 080453ef-ad9e-4336-9620-d07ac181a6b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-080453ef-ad9e-4336-9620-d07ac181a6b0', 'volume_size': 1} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:00 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ae7c671b-a023-4681-b01e-59f3f3b42887" returned: 0 in 0.369s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.804s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-393804106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b3273d-ccb0-4e76-97c0-803a4f08adff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0322c1aec44fae9aefdcd96e748a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:20:00Z,use_quota=True,user_id='e28fcf3523a44c7e990763659603d924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Creating volume c7b3273d-ccb0-4e76-97c0-803a4f08adff {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:20:00 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c7b3273d-ccb0-4e76-97c0-803a4f08adff 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9df6d17-1fa7-4c34-809a-24737860c05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae7c671b-a023-4681-b01e-59f3f3b42887', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78628b33-2815-4ddf-a821-41793e3c6320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:00 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c7b3273d-ccb0-4e76-97c0-803a4f08adff 1073741824 Sep 01 12:20:00 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:00 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Volume volume-ae7c671b-a023-4681-b01e-59f3f3b42887 (ae7c671b-a023-4681-b01e-59f3f3b42887): created successfully Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78628b33-2815-4ddf-a821-41793e3c6320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Flow 'volume_create_manager' (9ec22107-a90f-4241-aaa7-a71660c341ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:20:00 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1e349770-4470-4bf6-b9db-e3a35aae411f tempest-CreateVolumesFromSnapshotTest-455330224 None] Created volume successfully. Sep 01 12:20:01 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c7b3273d-ccb0-4e76-97c0-803a4f08adff 1073741824" returned: 0 in 0.513s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c7b3273d-ccb0-4e76-97c0-803a4f08adff {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:01 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c7b3273d-ccb0-4e76-97c0-803a4f08adff Sep 01 12:20:01 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:01 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c7b3273d-ccb0-4e76-97c0-803a4f08adff" returned: 0 in 0.341s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.344s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1669067424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed15201e-d7ec-4639-a7d3-c66b175a344a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0322c1aec44fae9aefdcd96e748a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:20:00Z,use_quota=True,user_id='e28fcf3523a44c7e990763659603d924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Creating volume ed15201e-d7ec-4639-a7d3-c66b175a344a {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:20:01 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ed15201e-d7ec-4639-a7d3-c66b175a344a 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:01 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ed15201e-d7ec-4639-a7d3-c66b175a344a 1073741824 Sep 01 12:20:01 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf36d71-1f2b-4ab1-b51b-3bb39cef1f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b3273d-ccb0-4e76-97c0-803a4f08adff', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d1828ed-79c8-4947-b217-5ff6f04c6539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:01 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Volume volume-c7b3273d-ccb0-4e76-97c0-803a4f08adff (c7b3273d-ccb0-4e76-97c0-803a4f08adff): created successfully Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d1828ed-79c8-4947-b217-5ff6f04c6539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Flow 'volume_create_manager' (61983e9e-0bcf-4a94-9924-2f4ca35ff4b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Flow 'volume_create_manager' (0d6b62e3-dfcc-4ad0-a293-fd8515928904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aea9dd4-b674-4607-946b-b31998b6f5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aea9dd4-b674-4607-946b-b31998b6f5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2044586387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=396958e5-337e-482c-b001-a09149ffc325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52206461fec54a63995ab8da6c026b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:20:02Z,use_quota=True,user_id='eb38befbbaef4f6883d55ed455a03121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966510f5-01ed-4e0d-bbf4-34c27efa742a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966510f5-01ed-4e0d-bbf4-34c27efa742a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8229097-2ac3-41f0-acd8-fa953a173f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8229097-2ac3-41f0-acd8-fa953a173f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '396958e5-337e-482c-b001-a09149ffc325', 'volume_name': 'volume-396958e5-337e-482c-b001-a09149ffc325', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c549f51-1416-47ad-811c-a4220b476ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c549f51-1416-47ad-811c-a4220b476ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce41395-8b15-4c7e-ba8a-d02fb37f2417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:01 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Volume 396958e5-337e-482c-b001-a09149ffc325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-396958e5-337e-482c-b001-a09149ffc325', 'volume_size': 1} Sep 01 12:20:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:01 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-12213175-b434-4a9e-8aef-59968881e482 tempest-CreateVolumesFromSnapshotTest-455330224 None] Created volume successfully. Sep 01 12:20:02 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ed15201e-d7ec-4639-a7d3-c66b175a344a 1073741824" returned: 0 in 0.561s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ed15201e-d7ec-4639-a7d3-c66b175a344a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:02 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ed15201e-d7ec-4639-a7d3-c66b175a344a Sep 01 12:20:02 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:02 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ed15201e-d7ec-4639-a7d3-c66b175a344a" returned: 0 in 0.249s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:20:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.788s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-788579894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080453ef-ad9e-4336-9620-d07ac181a6b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0322c1aec44fae9aefdcd96e748a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:20:01Z,use_quota=True,user_id='e28fcf3523a44c7e990763659603d924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:20:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Creating volume 080453ef-ad9e-4336-9620-d07ac181a6b0 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:20:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:20:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:20:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:20:02 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:20:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-080453ef-ad9e-4336-9620-d07ac181a6b0 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:02 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-080453ef-ad9e-4336-9620-d07ac181a6b0 1073741824 Sep 01 12:20:02 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfa0c34-a864-40b1-bb03-176a4776dfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed15201e-d7ec-4639-a7d3-c66b175a344a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c52a619f-6cd8-4c23-9a97-9c148ce64088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:02 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Volume volume-ed15201e-d7ec-4639-a7d3-c66b175a344a (ed15201e-d7ec-4639-a7d3-c66b175a344a): created successfully Sep 01 12:20:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c52a619f-6cd8-4c23-9a97-9c148ce64088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Flow 'volume_create_manager' (0a6ec275-dcb0-4647-b931-ff590afa1d72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:20:02 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-fdd8c4f2-b407-4261-b83e-ac436d421f37 tempest-CreateVolumesFromSnapshotTest-455330224 None] Created volume successfully. Sep 01 12:20:03 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-080453ef-ad9e-4336-9620-d07ac181a6b0 1073741824" returned: 0 in 0.510s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-080453ef-ad9e-4336-9620-d07ac181a6b0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:03 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-080453ef-ad9e-4336-9620-d07ac181a6b0 Sep 01 12:20:03 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:03 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-080453ef-ad9e-4336-9620-d07ac181a6b0" returned: 0 in 0.258s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:20:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.478s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2044586387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=396958e5-337e-482c-b001-a09149ffc325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52206461fec54a63995ab8da6c026b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:20:02Z,use_quota=True,user_id='eb38befbbaef4f6883d55ed455a03121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:20:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Creating volume 396958e5-337e-482c-b001-a09149ffc325 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:20:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:20:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:20:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:03 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:20:03 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:20:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-396958e5-337e-482c-b001-a09149ffc325 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be789cab-c671-47e6-a694-9f670f2869ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-080453ef-ad9e-4336-9620-d07ac181a6b0', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69654c59-2a8f-453b-a162-ae07303a57cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:03 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-396958e5-337e-482c-b001-a09149ffc325 1073741824 Sep 01 12:20:03 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:03 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Volume volume-080453ef-ad9e-4336-9620-d07ac181a6b0 (080453ef-ad9e-4336-9620-d07ac181a6b0): created successfully Sep 01 12:20:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69654c59-2a8f-453b-a162-ae07303a57cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:03 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Flow 'volume_create_manager' (6c9aad19-2ebc-48e1-b70a-602d1b593344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:20:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4ae674f6-5ba8-4a60-9223-f283aa221a7d tempest-CreateVolumesFromSnapshotTest-455330224 None] Created volume successfully. Sep 01 12:20:03 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-396958e5-337e-482c-b001-a09149ffc325 1073741824" returned: 0 in 0.505s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-396958e5-337e-482c-b001-a09149ffc325 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:03 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-396958e5-337e-482c-b001-a09149ffc325 Sep 01 12:20:03 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f42f5357-23ea-4c00-adf9-da8ebf093db9 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "cinder-080453ef-ad9e-4336-9620-d07ac181a6b0-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f42f5357-23ea-4c00-adf9-da8ebf093db9 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-080453ef-ad9e-4336-9620-d07ac181a6b0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f42f5357-23ea-4c00-adf9-da8ebf093db9 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "cinder-quobyte-080453ef-ad9e-4336-9620-d07ac181a6b0" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f42f5357-23ea-4c00-adf9-da8ebf093db9 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-quobyte-080453ef-ad9e-4336-9620-d07ac181a6b0" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:04 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcc543b-0c14-45c5-9737-b1c6a3e3ba55]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:20:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f42f5357-23ea-4c00-adf9-da8ebf093db9 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-080453ef-ad9e-4336-9620-d07ac181a6b0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:04 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-396958e5-337e-482c-b001-a09149ffc325" returned: 0 in 0.340s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:20:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce41395-8b15-4c7e-ba8a-d02fb37f2417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-396958e5-337e-482c-b001-a09149ffc325', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85cdfd73-efb9-480f-b3ea-bc00c43d9de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:04 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-080453ef-ad9e-4336-9620-d07ac181a6b0 Sep 01 12:20:04 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:04 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Volume volume-396958e5-337e-482c-b001-a09149ffc325 (396958e5-337e-482c-b001-a09149ffc325): created successfully Sep 01 12:20:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85cdfd73-efb9-480f-b3ea-bc00c43d9de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Flow 'volume_create_manager' (0d6b62e3-dfcc-4ad0-a293-fd8515928904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:20:04 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-da9bc3af-21a9-403b-a1ba-aa815f949af7 tempest-ProjectReaderTests-1834016642 None] Created volume successfully. Sep 01 12:20:04 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f42f5357-23ea-4c00-adf9-da8ebf093db9 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-080453ef-ad9e-4336-9620-d07ac181a6b0" returned: 0 in 0.417s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f42f5357-23ea-4c00-adf9-da8ebf093db9 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-080453ef-ad9e-4336-9620-d07ac181a6b0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:04 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-080453ef-ad9e-4336-9620-d07ac181a6b0 Sep 01 12:20:04 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:04 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f42f5357-23ea-4c00-adf9-da8ebf093db9 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-080453ef-ad9e-4336-9620-d07ac181a6b0" returned: 0 in 0.264s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f42f5357-23ea-4c00-adf9-da8ebf093db9 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-quobyte-080453ef-ad9e-4336-9620-d07ac181a6b0" released by "delete_volume" :: held 0.733s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:04 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-f42f5357-23ea-4c00-adf9-da8ebf093db9 tempest-CreateVolumesFromSnapshotTest-455330224 None] Created reservations ['e044633c-c1e8-4a1e-afa6-ea755c76c9bd', 'd5ff570b-8be1-4b9e-a53f-1eef90b88b01', '5fbf1f74-17d6-47d4-995d-90e2cb2cb31e', '540c25e2-dffb-4c24-a77c-864059903ed3'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f42f5357-23ea-4c00-adf9-da8ebf093db9 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f42f5357-23ea-4c00-adf9-da8ebf093db9 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f42f5357-23ea-4c00-adf9-da8ebf093db9 tempest-CreateVolumesFromSnapshotTest-455330224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f42f5357-23ea-4c00-adf9-da8ebf093db9 tempest-CreateVolumesFromSnapshotTest-455330224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f42f5357-23ea-4c00-adf9-da8ebf093db9 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f42f5357-23ea-4c00-adf9-da8ebf093db9 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ca3e8074-70b5-44c7-baaf-523a5e8784d7 tempest-ProjectReaderTests-1834016642 None] Acquiring lock "cinder-396958e5-337e-482c-b001-a09149ffc325-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:05 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ca3e8074-70b5-44c7-baaf-523a5e8784d7 tempest-ProjectReaderTests-1834016642 None] Lock "cinder-396958e5-337e-482c-b001-a09149ffc325-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:05 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ca3e8074-70b5-44c7-baaf-523a5e8784d7 tempest-ProjectReaderTests-1834016642 None] Acquiring lock "cinder-quobyte-396958e5-337e-482c-b001-a09149ffc325" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ca3e8074-70b5-44c7-baaf-523a5e8784d7 tempest-ProjectReaderTests-1834016642 None] Lock "cinder-quobyte-396958e5-337e-482c-b001-a09149ffc325" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[063c8506-6d0e-4a95-9f67-9ac3467d46b6]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ca3e8074-70b5-44c7-baaf-523a5e8784d7 tempest-ProjectReaderTests-1834016642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-396958e5-337e-482c-b001-a09149ffc325 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-60a72e74-7850-48d0-aa12-55ee1eb5c48f tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "cinder-ed15201e-d7ec-4639-a7d3-c66b175a344a-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-60a72e74-7850-48d0-aa12-55ee1eb5c48f tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-ed15201e-d7ec-4639-a7d3-c66b175a344a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-60a72e74-7850-48d0-aa12-55ee1eb5c48f tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "cinder-quobyte-ed15201e-d7ec-4639-a7d3-c66b175a344a" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-60a72e74-7850-48d0-aa12-55ee1eb5c48f tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-quobyte-ed15201e-d7ec-4639-a7d3-c66b175a344a" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:05 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-396958e5-337e-482c-b001-a09149ffc325 Sep 01 12:20:05 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:05 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f42f5357-23ea-4c00-adf9-da8ebf093db9 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.369s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-f42f5357-23ea-4c00-adf9-da8ebf093db9 tempest-CreateVolumesFromSnapshotTest-455330224 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:20:05 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f42f5357-23ea-4c00-adf9-da8ebf093db9 tempest-CreateVolumesFromSnapshotTest-455330224 None] Deleted volume successfully. Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e32e33-d0fe-49d2-a96d-fc8f14deb6b8]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60a72e74-7850-48d0-aa12-55ee1eb5c48f tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ed15201e-d7ec-4639-a7d3-c66b175a344a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f42f5357-23ea-4c00-adf9-da8ebf093db9 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-080453ef-ad9e-4336-9620-d07ac181a6b0-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:05 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ed15201e-d7ec-4639-a7d3-c66b175a344a Sep 01 12:20:05 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:05 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ca3e8074-70b5-44c7-baaf-523a5e8784d7 tempest-ProjectReaderTests-1834016642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-396958e5-337e-482c-b001-a09149ffc325" returned: 0 in 0.525s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ca3e8074-70b5-44c7-baaf-523a5e8784d7 tempest-ProjectReaderTests-1834016642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-396958e5-337e-482c-b001-a09149ffc325 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:05 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-396958e5-337e-482c-b001-a09149ffc325 Sep 01 12:20:05 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:05 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60a72e74-7850-48d0-aa12-55ee1eb5c48f tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ed15201e-d7ec-4639-a7d3-c66b175a344a" returned: 0 in 0.444s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60a72e74-7850-48d0-aa12-55ee1eb5c48f tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ed15201e-d7ec-4639-a7d3-c66b175a344a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:05 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ed15201e-d7ec-4639-a7d3-c66b175a344a Sep 01 12:20:05 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:05 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ca3e8074-70b5-44c7-baaf-523a5e8784d7 tempest-ProjectReaderTests-1834016642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-396958e5-337e-482c-b001-a09149ffc325" returned: 0 in 0.286s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ca3e8074-70b5-44c7-baaf-523a5e8784d7 tempest-ProjectReaderTests-1834016642 None] Lock "cinder-quobyte-396958e5-337e-482c-b001-a09149ffc325" released by "delete_volume" :: held 0.871s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-ca3e8074-70b5-44c7-baaf-523a5e8784d7 tempest-ProjectReaderTests-1834016642 None] Created reservations ['4052e954-082c-4d0d-a40b-0fd6ad2f3c8b', '3dfba97b-ded0-4081-8b28-114d53263220', '6b64964b-75b9-4e70-8fbd-5e301ed7efa0', 'ed443d56-9338-4e29-9d45-089dc4498442'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ca3e8074-70b5-44c7-baaf-523a5e8784d7 tempest-ProjectReaderTests-1834016642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ca3e8074-70b5-44c7-baaf-523a5e8784d7 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e8074-70b5-44c7-baaf-523a5e8784d7 tempest-ProjectReaderTests-1834016642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e8074-70b5-44c7-baaf-523a5e8784d7 tempest-ProjectReaderTests-1834016642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ca3e8074-70b5-44c7-baaf-523a5e8784d7 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ca3e8074-70b5-44c7-baaf-523a5e8784d7 tempest-ProjectReaderTests-1834016642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:06 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60a72e74-7850-48d0-aa12-55ee1eb5c48f tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ed15201e-d7ec-4639-a7d3-c66b175a344a" returned: 0 in 0.326s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:06 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:20:06 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-60a72e74-7850-48d0-aa12-55ee1eb5c48f tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-quobyte-ed15201e-d7ec-4639-a7d3-c66b175a344a" released by "delete_volume" :: held 0.828s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-60a72e74-7850-48d0-aa12-55ee1eb5c48f tempest-CreateVolumesFromSnapshotTest-455330224 None] Created reservations ['b5404bc1-281f-4458-8d4b-9a4a5cd74871', '00888d61-0ab9-4b29-86f6-d4a48dc6fd49', '8de5ed92-1248-4405-ab33-27d4144eedc3', 'ae6e4f09-a527-4a03-892d-3d6e350f85bb'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-60a72e74-7850-48d0-aa12-55ee1eb5c48f tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-60a72e74-7850-48d0-aa12-55ee1eb5c48f tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-60a72e74-7850-48d0-aa12-55ee1eb5c48f tempest-CreateVolumesFromSnapshotTest-455330224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-60a72e74-7850-48d0-aa12-55ee1eb5c48f tempest-CreateVolumesFromSnapshotTest-455330224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-60a72e74-7850-48d0-aa12-55ee1eb5c48f tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60a72e74-7850-48d0-aa12-55ee1eb5c48f tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:06 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:20:06 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b05f974a-ccb6-4548-8d7d-10a0f0f782c4 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "cinder-c7b3273d-ccb0-4e76-97c0-803a4f08adff-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b05f974a-ccb6-4548-8d7d-10a0f0f782c4 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-c7b3273d-ccb0-4e76-97c0-803a4f08adff-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:06 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ca3e8074-70b5-44c7-baaf-523a5e8784d7 tempest-ProjectReaderTests-1834016642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.464s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-ca3e8074-70b5-44c7-baaf-523a5e8784d7 tempest-ProjectReaderTests-1834016642 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:20:06 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ca3e8074-70b5-44c7-baaf-523a5e8784d7 tempest-ProjectReaderTests-1834016642 None] Deleted volume successfully. Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b05f974a-ccb6-4548-8d7d-10a0f0f782c4 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "cinder-quobyte-c7b3273d-ccb0-4e76-97c0-803a4f08adff" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ca3e8074-70b5-44c7-baaf-523a5e8784d7 tempest-ProjectReaderTests-1834016642 None] Lock "cinder-396958e5-337e-482c-b001-a09149ffc325-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b05f974a-ccb6-4548-8d7d-10a0f0f782c4 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-quobyte-c7b3273d-ccb0-4e76-97c0-803a4f08adff" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac6a21e-30b8-4a34-8e75-7e360ca9f192]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b05f974a-ccb6-4548-8d7d-10a0f0f782c4 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c7b3273d-ccb0-4e76-97c0-803a4f08adff {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:06 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-60a72e74-7850-48d0-aa12-55ee1eb5c48f tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.449s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-60a72e74-7850-48d0-aa12-55ee1eb5c48f tempest-CreateVolumesFromSnapshotTest-455330224 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:20:06 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-60a72e74-7850-48d0-aa12-55ee1eb5c48f tempest-CreateVolumesFromSnapshotTest-455330224 None] Deleted volume successfully. Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-60a72e74-7850-48d0-aa12-55ee1eb5c48f tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-ed15201e-d7ec-4639-a7d3-c66b175a344a-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:06 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c7b3273d-ccb0-4e76-97c0-803a4f08adff Sep 01 12:20:06 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Flow 'volume_create_manager' (923174b4-aea4-4751-ae84-3dd8d5e7f1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:20:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd518d5-b6ea-4389-a991-14c40ec2bf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd518d5-b6ea-4389-a991-14c40ec2bf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2078289257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a24fecc-9088-4ad1-83fd-c623420f110a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52206461fec54a63995ab8da6c026b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:20:07Z,use_quota=True,user_id='eb38befbbaef4f6883d55ed455a03121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e558e2ba-41d0-43d4-b6ae-4c611bfa5093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e558e2ba-41d0-43d4-b6ae-4c611bfa5093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4dd64ba-c681-4346-aee6-501bfd41b60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4dd64ba-c681-4346-aee6-501bfd41b60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a24fecc-9088-4ad1-83fd-c623420f110a', 'volume_name': 'volume-3a24fecc-9088-4ad1-83fd-c623420f110a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44987ee-8c15-478f-89ca-f3c97f8e891d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44987ee-8c15-478f-89ca-f3c97f8e891d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d973416-233b-4212-8333-3a6355e5ffc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:07 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Volume 3a24fecc-9088-4ad1-83fd-c623420f110a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a24fecc-9088-4ad1-83fd-c623420f110a', 'volume_size': 1} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2078289257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a24fecc-9088-4ad1-83fd-c623420f110a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52206461fec54a63995ab8da6c026b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:20:07Z,use_quota=True,user_id='eb38befbbaef4f6883d55ed455a03121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Creating volume 3a24fecc-9088-4ad1-83fd-c623420f110a {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:20:07 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a24fecc-9088-4ad1-83fd-c623420f110a 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:07 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a24fecc-9088-4ad1-83fd-c623420f110a 1073741824 Sep 01 12:20:07 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:07 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b05f974a-ccb6-4548-8d7d-10a0f0f782c4 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c7b3273d-ccb0-4e76-97c0-803a4f08adff" returned: 0 in 0.445s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b05f974a-ccb6-4548-8d7d-10a0f0f782c4 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c7b3273d-ccb0-4e76-97c0-803a4f08adff {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:07 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c7b3273d-ccb0-4e76-97c0-803a4f08adff Sep 01 12:20:07 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:07 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b05f974a-ccb6-4548-8d7d-10a0f0f782c4 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c7b3273d-ccb0-4e76-97c0-803a4f08adff" returned: 0 in 0.279s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b05f974a-ccb6-4548-8d7d-10a0f0f782c4 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-quobyte-c7b3273d-ccb0-4e76-97c0-803a4f08adff" released by "delete_volume" :: held 0.777s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:07 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a24fecc-9088-4ad1-83fd-c623420f110a 1073741824" returned: 0 in 0.471s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a24fecc-9088-4ad1-83fd-c623420f110a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-b05f974a-ccb6-4548-8d7d-10a0f0f782c4 tempest-CreateVolumesFromSnapshotTest-455330224 None] Created reservations ['73bff478-3215-4d66-b1fc-ae418c65f388', 'aa1a90df-9694-422b-abda-ec5df8563e5b', 'c43283ec-3301-4fd4-8ae1-f8bea7ce80ea', 'd5d82798-2d98-4665-bdaf-d8e84e4c76a2'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:20:07 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a24fecc-9088-4ad1-83fd-c623420f110a Sep 01 12:20:07 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b05f974a-ccb6-4548-8d7d-10a0f0f782c4 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b05f974a-ccb6-4548-8d7d-10a0f0f782c4 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b05f974a-ccb6-4548-8d7d-10a0f0f782c4 tempest-CreateVolumesFromSnapshotTest-455330224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b05f974a-ccb6-4548-8d7d-10a0f0f782c4 tempest-CreateVolumesFromSnapshotTest-455330224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b05f974a-ccb6-4548-8d7d-10a0f0f782c4 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b05f974a-ccb6-4548-8d7d-10a0f0f782c4 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:07 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:20:07 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:07 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a24fecc-9088-4ad1-83fd-c623420f110a" returned: 0 in 0.335s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d973416-233b-4212-8333-3a6355e5ffc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a24fecc-9088-4ad1-83fd-c623420f110a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229ee2f0-eb8e-4a02-a2d2-bb92689b043f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:07 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Volume volume-3a24fecc-9088-4ad1-83fd-c623420f110a (3a24fecc-9088-4ad1-83fd-c623420f110a): created successfully Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229ee2f0-eb8e-4a02-a2d2-bb92689b043f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Flow 'volume_create_manager' (923174b4-aea4-4751-ae84-3dd8d5e7f1f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:20:08 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-68f3c6bb-7485-4d7f-9d09-c550d5738134 tempest-ProjectReaderTests-1834016642 None] Created volume successfully. Sep 01 12:20:08 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b05f974a-ccb6-4548-8d7d-10a0f0f782c4 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.263s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:08 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b05f974a-ccb6-4548-8d7d-10a0f0f782c4 tempest-CreateVolumesFromSnapshotTest-455330224 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:20:08 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b05f974a-ccb6-4548-8d7d-10a0f0f782c4 tempest-CreateVolumesFromSnapshotTest-455330224 None] Deleted volume successfully. Sep 01 12:20:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b05f974a-ccb6-4548-8d7d-10a0f0f782c4 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-c7b3273d-ccb0-4e76-97c0-803a4f08adff-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85306ae0-4393-4e0c-9603-3cf1abf0b586 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "cinder-ae7c671b-a023-4681-b01e-59f3f3b42887-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85306ae0-4393-4e0c-9603-3cf1abf0b586 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-ae7c671b-a023-4681-b01e-59f3f3b42887-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85306ae0-4393-4e0c-9603-3cf1abf0b586 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "cinder-quobyte-ae7c671b-a023-4681-b01e-59f3f3b42887" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85306ae0-4393-4e0c-9603-3cf1abf0b586 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-quobyte-ae7c671b-a023-4681-b01e-59f3f3b42887" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:08 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[94597be4-faca-4ca7-810e-8c7e940423a3]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:20:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85306ae0-4393-4e0c-9603-3cf1abf0b586 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ae7c671b-a023-4681-b01e-59f3f3b42887 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7c06f9df-05bb-48d4-8db5-a3caf5a895bc tempest-ProjectReaderTests-1834016642 None] Acquiring lock "cinder-3a24fecc-9088-4ad1-83fd-c623420f110a-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7c06f9df-05bb-48d4-8db5-a3caf5a895bc tempest-ProjectReaderTests-1834016642 None] Lock "cinder-3a24fecc-9088-4ad1-83fd-c623420f110a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7c06f9df-05bb-48d4-8db5-a3caf5a895bc tempest-ProjectReaderTests-1834016642 None] Acquiring lock "cinder-quobyte-3a24fecc-9088-4ad1-83fd-c623420f110a" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7c06f9df-05bb-48d4-8db5-a3caf5a895bc tempest-ProjectReaderTests-1834016642 None] Lock "cinder-quobyte-3a24fecc-9088-4ad1-83fd-c623420f110a" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:09 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ae7c671b-a023-4681-b01e-59f3f3b42887 Sep 01 12:20:09 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:09 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a9b5d6-7589-4d18-bbeb-f15b2a6e65c9]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:20:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c06f9df-05bb-48d4-8db5-a3caf5a895bc tempest-ProjectReaderTests-1834016642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a24fecc-9088-4ad1-83fd-c623420f110a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:09 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a24fecc-9088-4ad1-83fd-c623420f110a Sep 01 12:20:09 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:09 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85306ae0-4393-4e0c-9603-3cf1abf0b586 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ae7c671b-a023-4681-b01e-59f3f3b42887" returned: 0 in 0.452s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85306ae0-4393-4e0c-9603-3cf1abf0b586 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ae7c671b-a023-4681-b01e-59f3f3b42887 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:09 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ae7c671b-a023-4681-b01e-59f3f3b42887 Sep 01 12:20:09 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:09 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c06f9df-05bb-48d4-8db5-a3caf5a895bc tempest-ProjectReaderTests-1834016642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a24fecc-9088-4ad1-83fd-c623420f110a" returned: 0 in 0.435s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c06f9df-05bb-48d4-8db5-a3caf5a895bc tempest-ProjectReaderTests-1834016642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a24fecc-9088-4ad1-83fd-c623420f110a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:09 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a24fecc-9088-4ad1-83fd-c623420f110a Sep 01 12:20:09 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:09 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85306ae0-4393-4e0c-9603-3cf1abf0b586 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ae7c671b-a023-4681-b01e-59f3f3b42887" returned: 0 in 0.296s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85306ae0-4393-4e0c-9603-3cf1abf0b586 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-quobyte-ae7c671b-a023-4681-b01e-59f3f3b42887" released by "delete_volume" :: held 0.814s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:09 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-85306ae0-4393-4e0c-9603-3cf1abf0b586 tempest-CreateVolumesFromSnapshotTest-455330224 None] Created reservations ['bc1101f5-ee9e-4f17-b3df-e1c78ffb4dcd', 'a72bf8d7-8224-4659-bb19-1e46641679b0', '15283149-36b3-42a8-8473-478e360e987a', '33a28683-bad9-4e5d-b637-5ded99b78e5a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:20:10 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c06f9df-05bb-48d4-8db5-a3caf5a895bc tempest-ProjectReaderTests-1834016642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3a24fecc-9088-4ad1-83fd-c623420f110a" returned: 0 in 0.390s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7c06f9df-05bb-48d4-8db5-a3caf5a895bc tempest-ProjectReaderTests-1834016642 None] Lock "cinder-quobyte-3a24fecc-9088-4ad1-83fd-c623420f110a" released by "delete_volume" :: held 0.887s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-85306ae0-4393-4e0c-9603-3cf1abf0b586 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-85306ae0-4393-4e0c-9603-3cf1abf0b586 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-85306ae0-4393-4e0c-9603-3cf1abf0b586 tempest-CreateVolumesFromSnapshotTest-455330224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-85306ae0-4393-4e0c-9603-3cf1abf0b586 tempest-CreateVolumesFromSnapshotTest-455330224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-85306ae0-4393-4e0c-9603-3cf1abf0b586 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85306ae0-4393-4e0c-9603-3cf1abf0b586 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:10 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:20:10 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-7c06f9df-05bb-48d4-8db5-a3caf5a895bc tempest-ProjectReaderTests-1834016642 None] Created reservations ['30d306d0-c9eb-44df-a598-d54f98a25cb5', '3f60e4d1-d83c-4ebf-8517-b9a4e079578c', '0bb439b3-2ac1-49f2-8896-0cde80a3ef9f', 'f3d4aa95-df7f-4b0a-a5d5-1c85e354ed06'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7c06f9df-05bb-48d4-8db5-a3caf5a895bc tempest-ProjectReaderTests-1834016642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7c06f9df-05bb-48d4-8db5-a3caf5a895bc tempest-ProjectReaderTests-1834016642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7c06f9df-05bb-48d4-8db5-a3caf5a895bc tempest-ProjectReaderTests-1834016642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7c06f9df-05bb-48d4-8db5-a3caf5a895bc tempest-ProjectReaderTests-1834016642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7c06f9df-05bb-48d4-8db5-a3caf5a895bc tempest-ProjectReaderTests-1834016642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c06f9df-05bb-48d4-8db5-a3caf5a895bc tempest-ProjectReaderTests-1834016642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:10 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:20:10 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:10 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-85306ae0-4393-4e0c-9603-3cf1abf0b586 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.332s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-85306ae0-4393-4e0c-9603-3cf1abf0b586 tempest-CreateVolumesFromSnapshotTest-455330224 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:20:10 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-85306ae0-4393-4e0c-9603-3cf1abf0b586 tempest-CreateVolumesFromSnapshotTest-455330224 None] Deleted volume successfully. Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-85306ae0-4393-4e0c-9603-3cf1abf0b586 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-ae7c671b-a023-4681-b01e-59f3f3b42887-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:10 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c06f9df-05bb-48d4-8db5-a3caf5a895bc tempest-ProjectReaderTests-1834016642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.481s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-7c06f9df-05bb-48d4-8db5-a3caf5a895bc tempest-ProjectReaderTests-1834016642 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:20:10 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7c06f9df-05bb-48d4-8db5-a3caf5a895bc tempest-ProjectReaderTests-1834016642 None] Deleted volume successfully. Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7c06f9df-05bb-48d4-8db5-a3caf5a895bc tempest-ProjectReaderTests-1834016642 None] Lock "cinder-3a24fecc-9088-4ad1-83fd-c623420f110a-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Flow 'volume_create_manager' (2b87a487-8db2-4039-9816-7b290fcbc9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb348e4d-cdaf-46aa-92e4-7b2c9c798f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb348e4d-cdaf-46aa-92e4-7b2c9c798f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653126028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311429ab-e330-47ec-a080-1bc5fc14b6c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52206461fec54a63995ab8da6c026b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:20:11Z,use_quota=True,user_id='eb38befbbaef4f6883d55ed455a03121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0f8a0d-e16d-448a-a1d3-2f37e1b7e2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0f8a0d-e16d-448a-a1d3-2f37e1b7e2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e6ea7b-f527-4bcf-9e24-b10a1abb8a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e6ea7b-f527-4bcf-9e24-b10a1abb8a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '311429ab-e330-47ec-a080-1bc5fc14b6c8', 'volume_name': 'volume-311429ab-e330-47ec-a080-1bc5fc14b6c8', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8c5dfe-c4b2-4f5f-ad63-d719abe0b33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8c5dfe-c4b2-4f5f-ad63-d719abe0b33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d48f73-944e-4389-9c88-9c70230c380f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:11 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Volume 311429ab-e330-47ec-a080-1bc5fc14b6c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-311429ab-e330-47ec-a080-1bc5fc14b6c8', 'volume_size': 1} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653126028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311429ab-e330-47ec-a080-1bc5fc14b6c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52206461fec54a63995ab8da6c026b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:20:11Z,use_quota=True,user_id='eb38befbbaef4f6883d55ed455a03121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Creating volume 311429ab-e330-47ec-a080-1bc5fc14b6c8 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:20:11 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-311429ab-e330-47ec-a080-1bc5fc14b6c8 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:11 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-311429ab-e330-47ec-a080-1bc5fc14b6c8 1073741824 Sep 01 12:20:11 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d66b142a-c6d2-4d9d-8dbb-f60a785f1df1 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "cinder-78073955-60dd-46eb-91bc-09b0e745097c-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d66b142a-c6d2-4d9d-8dbb-f60a785f1df1 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-78073955-60dd-46eb-91bc-09b0e745097c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d66b142a-c6d2-4d9d-8dbb-f60a785f1df1 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "cinder-quobyte-78073955-60dd-46eb-91bc-09b0e745097c" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d66b142a-c6d2-4d9d-8dbb-f60a785f1df1 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-quobyte-78073955-60dd-46eb-91bc-09b0e745097c" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[04683891-444c-45a1-a296-cb1b6a052a21]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d66b142a-c6d2-4d9d-8dbb-f60a785f1df1 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-78073955-60dd-46eb-91bc-09b0e745097c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:11 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-78073955-60dd-46eb-91bc-09b0e745097c Sep 01 12:20:11 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:11 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-311429ab-e330-47ec-a080-1bc5fc14b6c8 1073741824" returned: 0 in 0.511s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-311429ab-e330-47ec-a080-1bc5fc14b6c8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:11 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-311429ab-e330-47ec-a080-1bc5fc14b6c8 Sep 01 12:20:11 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:11 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d66b142a-c6d2-4d9d-8dbb-f60a785f1df1 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-78073955-60dd-46eb-91bc-09b0e745097c" returned: 0 in 0.453s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d66b142a-c6d2-4d9d-8dbb-f60a785f1df1 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-78073955-60dd-46eb-91bc-09b0e745097c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:11 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-78073955-60dd-46eb-91bc-09b0e745097c Sep 01 12:20:11 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:11 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-311429ab-e330-47ec-a080-1bc5fc14b6c8" returned: 0 in 0.334s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d48f73-944e-4389-9c88-9c70230c380f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-311429ab-e330-47ec-a080-1bc5fc14b6c8', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ae4ee8-3317-49a6-ab27-845efb7ef6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:11 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Volume volume-311429ab-e330-47ec-a080-1bc5fc14b6c8 (311429ab-e330-47ec-a080-1bc5fc14b6c8): created successfully Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ae4ee8-3317-49a6-ab27-845efb7ef6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Flow 'volume_create_manager' (2b87a487-8db2-4039-9816-7b290fcbc9e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:20:12 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-988cea2c-f2d1-4674-8b23-f1bc3971aeb7 tempest-ProjectReaderTests-1834016642 None] Created volume successfully. Sep 01 12:20:12 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d66b142a-c6d2-4d9d-8dbb-f60a785f1df1 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-78073955-60dd-46eb-91bc-09b0e745097c" returned: 0 in 0.300s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d66b142a-c6d2-4d9d-8dbb-f60a785f1df1 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-quobyte-78073955-60dd-46eb-91bc-09b0e745097c" released by "delete_volume" :: held 0.796s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-d66b142a-c6d2-4d9d-8dbb-f60a785f1df1 tempest-CreateVolumesFromSnapshotTest-455330224 None] Created reservations ['2a14a997-8a41-4b96-b11f-20ea55fb5393', '33dad1e0-6f22-409d-bf2d-001d9b0509a0', '26234e9a-3949-419d-90b4-f9ca12d95add', 'b4d78a71-94c0-4675-a9af-f702b554b7a1'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d66b142a-c6d2-4d9d-8dbb-f60a785f1df1 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d66b142a-c6d2-4d9d-8dbb-f60a785f1df1 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d66b142a-c6d2-4d9d-8dbb-f60a785f1df1 tempest-CreateVolumesFromSnapshotTest-455330224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d66b142a-c6d2-4d9d-8dbb-f60a785f1df1 tempest-CreateVolumesFromSnapshotTest-455330224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d66b142a-c6d2-4d9d-8dbb-f60a785f1df1 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d66b142a-c6d2-4d9d-8dbb-f60a785f1df1 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:12 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:20:12 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "cinder-314e4548-dda5-4c34-a26a-0b1a08dd17a9-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-314e4548-dda5-4c34-a26a-0b1a08dd17a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "cinder-quobyte-89f010d1-cd2f-4f48-943f-0d4afe495868" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-quobyte-89f010d1-cd2f-4f48-943f-0d4afe495868" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "cinder-quobyte-314e4548-dda5-4c34-a26a-0b1a08dd17a9" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-quobyte-314e4548-dda5-4c34-a26a-0b1a08dd17a9" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] Deleting offline snapshot 314e4548-dda5-4c34-a26a-0b1a08dd17a9 of volume 89f010d1-cd2f-4f48-943f-0d4afe495868 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] snapshot_file for this snap is: volume-89f010d1-cd2f-4f48-943f-0d4afe495868.314e4548-dda5-4c34-a26a-0b1a08dd17a9 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9208c633-07e3-4ad2-80e5-c42182d251d5]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.314e4548-dda5-4c34-a26a-0b1a08dd17a9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:12 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d66b142a-c6d2-4d9d-8dbb-f60a785f1df1 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.305s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-d66b142a-c6d2-4d9d-8dbb-f60a785f1df1 tempest-CreateVolumesFromSnapshotTest-455330224 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:20:12 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d66b142a-c6d2-4d9d-8dbb-f60a785f1df1 tempest-CreateVolumesFromSnapshotTest-455330224 None] Deleted volume successfully. Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d66b142a-c6d2-4d9d-8dbb-f60a785f1df1 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-78073955-60dd-46eb-91bc-09b0e745097c-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:12 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.314e4548-dda5-4c34-a26a-0b1a08dd17a9 Sep 01 12:20:12 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:12 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.314e4548-dda5-4c34-a26a-0b1a08dd17a9" returned: 0 in 0.455s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89f010d1-cd2f-4f48-943f-0d4afe495868(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f905fae-7d4a-4bd2-802f-cf22c45635b2]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:20:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:13 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868 Sep 01 12:20:13 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ebeb352f-e6be-4c22-b248-54e11514f856 tempest-ProjectReaderTests-1834016642 None] Acquiring lock "cinder-311429ab-e330-47ec-a080-1bc5fc14b6c8-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ebeb352f-e6be-4c22-b248-54e11514f856 tempest-ProjectReaderTests-1834016642 None] Lock "cinder-311429ab-e330-47ec-a080-1bc5fc14b6c8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ebeb352f-e6be-4c22-b248-54e11514f856 tempest-ProjectReaderTests-1834016642 None] Acquiring lock "cinder-quobyte-311429ab-e330-47ec-a080-1bc5fc14b6c8" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ebeb352f-e6be-4c22-b248-54e11514f856 tempest-ProjectReaderTests-1834016642 None] Lock "cinder-quobyte-311429ab-e330-47ec-a080-1bc5fc14b6c8" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:13 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a065ca67-d467-4943-9823-91b378b7eaf1]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:20:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ebeb352f-e6be-4c22-b248-54e11514f856 tempest-ProjectReaderTests-1834016642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-311429ab-e330-47ec-a080-1bc5fc14b6c8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:13 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868" returned: 0 in 0.422s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.314e4548-dda5-4c34-a26a-0b1a08dd17a9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:13 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-311429ab-e330-47ec-a080-1bc5fc14b6c8 Sep 01 12:20:13 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:13 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.314e4548-dda5-4c34-a26a-0b1a08dd17a9 Sep 01 12:20:13 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:13 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ebeb352f-e6be-4c22-b248-54e11514f856 tempest-ProjectReaderTests-1834016642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-311429ab-e330-47ec-a080-1bc5fc14b6c8" returned: 0 in 0.399s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ebeb352f-e6be-4c22-b248-54e11514f856 tempest-ProjectReaderTests-1834016642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-311429ab-e330-47ec-a080-1bc5fc14b6c8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:13 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-311429ab-e330-47ec-a080-1bc5fc14b6c8 Sep 01 12:20:13 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:13 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.314e4548-dda5-4c34-a26a-0b1a08dd17a9" returned: 0 in 0.423s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.314e4548-dda5-4c34-a26a-0b1a08dd17a9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:13 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.314e4548-dda5-4c34-a26a-0b1a08dd17a9 Sep 01 12:20:13 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:13 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ebeb352f-e6be-4c22-b248-54e11514f856 tempest-ProjectReaderTests-1834016642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-311429ab-e330-47ec-a080-1bc5fc14b6c8" returned: 0 in 0.297s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ebeb352f-e6be-4c22-b248-54e11514f856 tempest-ProjectReaderTests-1834016642 None] Lock "cinder-quobyte-311429ab-e330-47ec-a080-1bc5fc14b6c8" released by "delete_volume" :: held 0.751s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:14 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-ebeb352f-e6be-4c22-b248-54e11514f856 tempest-ProjectReaderTests-1834016642 None] Created reservations ['d6313ac8-242f-4be5-bea7-6a379fdf0bc2', '2872ee9f-d97d-47da-a752-4c48453b384c', 'b403c47d-16ba-4cfa-8ef3-fa0c6c3b1cf8', 'c11aed5a-9b19-43f9-a879-53c8859398f5'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:20:14 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868.314e4548-dda5-4c34-a26a-0b1a08dd17a9" returned: 0 in 0.277s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-quobyte-314e4548-dda5-4c34-a26a-0b1a08dd17a9" released by "_delete_snapshot" :: held 1.703s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-quobyte-89f010d1-cd2f-4f48-943f-0d4afe495868" released by "delete_snapshot" :: held 1.740s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ebeb352f-e6be-4c22-b248-54e11514f856 tempest-ProjectReaderTests-1834016642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ebeb352f-e6be-4c22-b248-54e11514f856 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ebeb352f-e6be-4c22-b248-54e11514f856 tempest-ProjectReaderTests-1834016642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:20:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ebeb352f-e6be-4c22-b248-54e11514f856 tempest-ProjectReaderTests-1834016642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:20:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ebeb352f-e6be-4c22-b248-54e11514f856 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ebeb352f-e6be-4c22-b248-54e11514f856 tempest-ProjectReaderTests-1834016642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:14 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:20:14 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:14 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] Created reservations ['92633045-a6db-48b5-a411-8827e4f0a241', '6b79b75b-f511-41d1-999a-de749df31cef', '513f09ba-792e-402d-8d56-3356f00cf35c', 'fbdb8ade-56db-4a75-8106-2a72b74a7a60'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:20:14 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] Delete snapshot completed successfully. Sep 01 12:20:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-417cc725-2747-46a7-a98a-5d9b985dd422 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-314e4548-dda5-4c34-a26a-0b1a08dd17a9-delete_snapshot" released by "delete_snapshot" :: held 1.986s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:14 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ebeb352f-e6be-4c22-b248-54e11514f856 tempest-ProjectReaderTests-1834016642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.321s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:14 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-ebeb352f-e6be-4c22-b248-54e11514f856 tempest-ProjectReaderTests-1834016642 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:20:14 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ebeb352f-e6be-4c22-b248-54e11514f856 tempest-ProjectReaderTests-1834016642 None] Deleted volume successfully. Sep 01 12:20:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-56fde308-fd21-4994-8ff5-b069f646c0b7 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "cinder-89f010d1-cd2f-4f48-943f-0d4afe495868-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ebeb352f-e6be-4c22-b248-54e11514f856 tempest-ProjectReaderTests-1834016642 None] Lock "cinder-311429ab-e330-47ec-a080-1bc5fc14b6c8-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-56fde308-fd21-4994-8ff5-b069f646c0b7 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-89f010d1-cd2f-4f48-943f-0d4afe495868-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-56fde308-fd21-4994-8ff5-b069f646c0b7 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "cinder-quobyte-89f010d1-cd2f-4f48-943f-0d4afe495868" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-56fde308-fd21-4994-8ff5-b069f646c0b7 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-quobyte-89f010d1-cd2f-4f48-943f-0d4afe495868" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1802f68-f69f-4fef-94ea-c7fc88c36b40]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:20:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-56fde308-fd21-4994-8ff5-b069f646c0b7 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:14 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868 Sep 01 12:20:14 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Flow 'volume_create_manager' (0e0642d0-177d-4458-80c9-f22a84c17884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b17420-016c-4d3e-a904-f95c5d5b340b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b17420-016c-4d3e-a904-f95c5d5b340b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1312320405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da7f359-e1a9-4fc4-8892-4d642aeda48b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52206461fec54a63995ab8da6c026b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:20:15Z,use_quota=True,user_id='eb38befbbaef4f6883d55ed455a03121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc60d269-d4a2-441b-8980-f8d64d5920c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc60d269-d4a2-441b-8980-f8d64d5920c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8681e3ca-87c7-4c1c-b5ff-af7849abda0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8681e3ca-87c7-4c1c-b5ff-af7849abda0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4da7f359-e1a9-4fc4-8892-4d642aeda48b', 'volume_name': 'volume-4da7f359-e1a9-4fc4-8892-4d642aeda48b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5d66b8-c869-4e29-87e0-d8a934deb404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5d66b8-c869-4e29-87e0-d8a934deb404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13511b84-9129-40e6-89be-3455073d0474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:15 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Volume 4da7f359-e1a9-4fc4-8892-4d642aeda48b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4da7f359-e1a9-4fc4-8892-4d642aeda48b', 'volume_size': 1} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1312320405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da7f359-e1a9-4fc4-8892-4d642aeda48b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52206461fec54a63995ab8da6c026b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:20:15Z,use_quota=True,user_id='eb38befbbaef4f6883d55ed455a03121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Creating volume 4da7f359-e1a9-4fc4-8892-4d642aeda48b {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:20:15 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4da7f359-e1a9-4fc4-8892-4d642aeda48b 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:15 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4da7f359-e1a9-4fc4-8892-4d642aeda48b 1073741824 Sep 01 12:20:15 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:15 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-56fde308-fd21-4994-8ff5-b069f646c0b7 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868" returned: 0 in 0.495s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-56fde308-fd21-4994-8ff5-b069f646c0b7 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:15 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868 Sep 01 12:20:15 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:15 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-56fde308-fd21-4994-8ff5-b069f646c0b7 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-89f010d1-cd2f-4f48-943f-0d4afe495868" returned: 0 in 0.268s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-56fde308-fd21-4994-8ff5-b069f646c0b7 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-quobyte-89f010d1-cd2f-4f48-943f-0d4afe495868" released by "delete_volume" :: held 0.847s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-56fde308-fd21-4994-8ff5-b069f646c0b7 tempest-CreateVolumesFromSnapshotTest-455330224 None] Created reservations ['12bcb2db-d604-464f-b812-b4e6695c66a2', '0efe047c-6c41-4865-91ca-d72810790aa2', '662d8f91-36f4-4a9b-988e-2ba4e529cadf', 'd5e63f3b-f1d8-470b-ad17-da5700d257e8'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-56fde308-fd21-4994-8ff5-b069f646c0b7 tempest-CreateVolumesFromSnapshotTest-455330224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-56fde308-fd21-4994-8ff5-b069f646c0b7 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-56fde308-fd21-4994-8ff5-b069f646c0b7 tempest-CreateVolumesFromSnapshotTest-455330224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-56fde308-fd21-4994-8ff5-b069f646c0b7 tempest-CreateVolumesFromSnapshotTest-455330224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-56fde308-fd21-4994-8ff5-b069f646c0b7 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-56fde308-fd21-4994-8ff5-b069f646c0b7 tempest-CreateVolumesFromSnapshotTest-455330224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:15 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:20:15 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:15 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4da7f359-e1a9-4fc4-8892-4d642aeda48b 1073741824" returned: 0 in 0.686s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4da7f359-e1a9-4fc4-8892-4d642aeda48b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:15 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4da7f359-e1a9-4fc4-8892-4d642aeda48b Sep 01 12:20:15 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:16 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-56fde308-fd21-4994-8ff5-b069f646c0b7 tempest-CreateVolumesFromSnapshotTest-455330224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.378s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:16 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-56fde308-fd21-4994-8ff5-b069f646c0b7 tempest-CreateVolumesFromSnapshotTest-455330224 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:20:16 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-56fde308-fd21-4994-8ff5-b069f646c0b7 tempest-CreateVolumesFromSnapshotTest-455330224 None] Deleted volume successfully. Sep 01 12:20:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-56fde308-fd21-4994-8ff5-b069f646c0b7 tempest-CreateVolumesFromSnapshotTest-455330224 None] Lock "cinder-89f010d1-cd2f-4f48-943f-0d4afe495868-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:16 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4da7f359-e1a9-4fc4-8892-4d642aeda48b" returned: 0 in 0.309s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:20:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13511b84-9129-40e6-89be-3455073d0474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4da7f359-e1a9-4fc4-8892-4d642aeda48b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04efdb2-cc6e-4759-9d16-e55fa2eed877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:16 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Volume volume-4da7f359-e1a9-4fc4-8892-4d642aeda48b (4da7f359-e1a9-4fc4-8892-4d642aeda48b): created successfully Sep 01 12:20:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04efdb2-cc6e-4759-9d16-e55fa2eed877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Flow 'volume_create_manager' (0e0642d0-177d-4458-80c9-f22a84c17884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:20:16 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-fbdc47bd-37fd-4a6b-bb64-c820e09b4fc8 tempest-ProjectReaderTests-1834016642 None] Created volume successfully. Sep 01 12:20:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-774dcf9a-4efb-40cb-b710-24f562df5ba3 tempest-ProjectReaderTests-1834016642 None] Acquiring lock "cinder-4da7f359-e1a9-4fc4-8892-4d642aeda48b-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-774dcf9a-4efb-40cb-b710-24f562df5ba3 tempest-ProjectReaderTests-1834016642 None] Lock "cinder-4da7f359-e1a9-4fc4-8892-4d642aeda48b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-774dcf9a-4efb-40cb-b710-24f562df5ba3 tempest-ProjectReaderTests-1834016642 None] Acquiring lock "cinder-quobyte-4da7f359-e1a9-4fc4-8892-4d642aeda48b" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-774dcf9a-4efb-40cb-b710-24f562df5ba3 tempest-ProjectReaderTests-1834016642 None] Lock "cinder-quobyte-4da7f359-e1a9-4fc4-8892-4d642aeda48b" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:17 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb68c5e-b5f3-41c5-834e-35efe70aa382]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:20:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-774dcf9a-4efb-40cb-b710-24f562df5ba3 tempest-ProjectReaderTests-1834016642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4da7f359-e1a9-4fc4-8892-4d642aeda48b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:17 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4da7f359-e1a9-4fc4-8892-4d642aeda48b Sep 01 12:20:17 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:17 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-774dcf9a-4efb-40cb-b710-24f562df5ba3 tempest-ProjectReaderTests-1834016642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4da7f359-e1a9-4fc4-8892-4d642aeda48b" returned: 0 in 0.483s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-774dcf9a-4efb-40cb-b710-24f562df5ba3 tempest-ProjectReaderTests-1834016642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4da7f359-e1a9-4fc4-8892-4d642aeda48b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:17 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4da7f359-e1a9-4fc4-8892-4d642aeda48b Sep 01 12:20:17 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:18 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-774dcf9a-4efb-40cb-b710-24f562df5ba3 tempest-ProjectReaderTests-1834016642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-4da7f359-e1a9-4fc4-8892-4d642aeda48b" returned: 0 in 0.305s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-774dcf9a-4efb-40cb-b710-24f562df5ba3 tempest-ProjectReaderTests-1834016642 None] Lock "cinder-quobyte-4da7f359-e1a9-4fc4-8892-4d642aeda48b" released by "delete_volume" :: held 0.838s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:18 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-774dcf9a-4efb-40cb-b710-24f562df5ba3 tempest-ProjectReaderTests-1834016642 None] Created reservations ['ba320745-672a-4a30-8848-0bf22d81ea7a', 'b240e5ac-1217-4f2b-a5b1-e56ac463a684', 'eea8de5d-7a31-40bb-a2bb-fc19355426e7', '63f92d4c-ac12-4968-b88d-0b876d0c0f68'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:20:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-774dcf9a-4efb-40cb-b710-24f562df5ba3 tempest-ProjectReaderTests-1834016642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-774dcf9a-4efb-40cb-b710-24f562df5ba3 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-774dcf9a-4efb-40cb-b710-24f562df5ba3 tempest-ProjectReaderTests-1834016642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:20:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-774dcf9a-4efb-40cb-b710-24f562df5ba3 tempest-ProjectReaderTests-1834016642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:20:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-774dcf9a-4efb-40cb-b710-24f562df5ba3 tempest-ProjectReaderTests-1834016642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-774dcf9a-4efb-40cb-b710-24f562df5ba3 tempest-ProjectReaderTests-1834016642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:18 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:20:18 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:18 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-774dcf9a-4efb-40cb-b710-24f562df5ba3 tempest-ProjectReaderTests-1834016642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.313s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:18 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-774dcf9a-4efb-40cb-b710-24f562df5ba3 tempest-ProjectReaderTests-1834016642 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:20:18 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-774dcf9a-4efb-40cb-b710-24f562df5ba3 tempest-ProjectReaderTests-1834016642 None] Deleted volume successfully. Sep 01 12:20:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-774dcf9a-4efb-40cb-b710-24f562df5ba3 tempest-ProjectReaderTests-1834016642 None] Lock "cinder-4da7f359-e1a9-4fc4-8892-4d642aeda48b-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Flow 'volume_create_manager' (6022027f-b322-4a3f-ade0-a8d3da7d7fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be72829-f106-48b9-8559-4dca5f88c97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be72829-f106-48b9-8559-4dca5f88c97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-950496786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cad45e7-c646-40f8-8b74-4d13023b2e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a0dc2ee08d429695b825d57aee6b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:20:24Z,use_quota=True,user_id='ca707abf543449039f59dcba5f62c2cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be1af17-1f5b-4e33-903a-687c17215c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be1af17-1f5b-4e33-903a-687c17215c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (082497bb-a110-4136-9093-3e4222a84766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (082497bb-a110-4136-9093-3e4222a84766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cad45e7-c646-40f8-8b74-4d13023b2e01', 'volume_name': 'volume-9cad45e7-c646-40f8-8b74-4d13023b2e01', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21d8a79-a09c-4672-8020-b9c0af7bec72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21d8a79-a09c-4672-8020-b9c0af7bec72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdedf17a-86c5-4343-8c3d-228323255d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:24 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Volume 9cad45e7-c646-40f8-8b74-4d13023b2e01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cad45e7-c646-40f8-8b74-4d13023b2e01', 'volume_size': 1} Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-950496786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cad45e7-c646-40f8-8b74-4d13023b2e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a0dc2ee08d429695b825d57aee6b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:20:24Z,use_quota=True,user_id='ca707abf543449039f59dcba5f62c2cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Creating volume 9cad45e7-c646-40f8-8b74-4d13023b2e01 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:20:24 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:24 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01 1073741824 Sep 01 12:20:24 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:24 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01 1073741824" returned: 0 in 0.584s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:25 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01 Sep 01 12:20:25 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:25 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01" returned: 0 in 0.275s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:20:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdedf17a-86c5-4343-8c3d-228323255d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cad45e7-c646-40f8-8b74-4d13023b2e01', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38487fc3-a933-44c6-977d-10769ea0237c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:25 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Volume volume-9cad45e7-c646-40f8-8b74-4d13023b2e01 (9cad45e7-c646-40f8-8b74-4d13023b2e01): created successfully Sep 01 12:20:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38487fc3-a933-44c6-977d-10769ea0237c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Flow 'volume_create_manager' (6022027f-b322-4a3f-ade0-a8d3da7d7fb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:20:25 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f695f707-894c-4019-8a1d-29487959a1d5 tempest-TestImageHashVerification-894627395 None] Created volume successfully. Sep 01 12:20:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b0709644-c137-402b-b485-62f9f483a07d tempest-TestImageHashVerification-894627395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b0709644-c137-402b-b485-62f9f483a07d tempest-TestImageHashVerification-894627395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:27 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c79a4b3-c425-4df1-931e-1526d1e65cdd]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:20:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b0709644-c137-402b-b485-62f9f483a07d tempest-TestImageHashVerification-894627395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:27 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01 Sep 01 12:20:27 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:28 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b0709644-c137-402b-b485-62f9f483a07d tempest-TestImageHashVerification-894627395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01" returned: 0 in 0.519s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:28 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[910766d4-a4fb-4c05-90b3-ea5ccf3881dd]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:20:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b0709644-c137-402b-b485-62f9f483a07d tempest-TestImageHashVerification-894627395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:28 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01 Sep 01 12:20:28 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:28 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b0709644-c137-402b-b485-62f9f483a07d tempest-TestImageHashVerification-894627395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01" returned: 0 in 0.413s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b0709644-c137-402b-b485-62f9f483a07d tempest-TestImageHashVerification-894627395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01 /opt/stack/data/cinder/conversion/9cad45e7-c646-40f8-8b74-4d13023b2e01.temp_image.ae0e6a45-71ac-418e-9f85-0a6e28cd4c5733x66rit.img {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:28 devstack sudo[102647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01 /opt/stack/data/cinder/conversion/9cad45e7-c646-40f8-8b74-4d13023b2e01.temp_image.ae0e6a45-71ac-418e-9f85-0a6e28cd4c5733x66rit.img Sep 01 12:20:28 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:33 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b0709644-c137-402b-b485-62f9f483a07d tempest-TestImageHashVerification-894627395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01 /opt/stack/data/cinder/conversion/9cad45e7-c646-40f8-8b74-4d13023b2e01.temp_image.ae0e6a45-71ac-418e-9f85-0a6e28cd4c5733x66rit.img" returned: 0 in 5.103s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:33 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[53087db8-6786-41ae-8120-18443147e09c]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:20:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b0709644-c137-402b-b485-62f9f483a07d tempest-TestImageHashVerification-894627395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:33 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01 Sep 01 12:20:33 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:34 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b0709644-c137-402b-b485-62f9f483a07d tempest-TestImageHashVerification-894627395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01" returned: 0 in 0.557s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:34 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-b0709644-c137-402b-b485-62f9f483a07d tempest-TestImageHashVerification-894627395 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01, size 1024.00 MB, duration 5.10 sec, destination /opt/stack/data/cinder/conversion/9cad45e7-c646-40f8-8b74-4d13023b2e01.temp_image.ae0e6a45-71ac-418e-9f85-0a6e28cd4c5733x66rit.img {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:20:34 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-b0709644-c137-402b-b485-62f9f483a07d tempest-TestImageHashVerification-894627395 None] Converted 1024.00 MB image at 200.61 MB/s Sep 01 12:20:34 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=251,cinder:INSERT=53,cinder:SELECT=170,cinder:DELETE=20 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:20:34 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:DELETE=23,cinder:SELECT=175,cinder:UPDATE=228,cinder:INSERT=63 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:20:34 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-b0709644-c137-402b-b485-62f9f483a07d tempest-TestImageHashVerification-894627395 None] ae0e6a45-71ac-418e-9f85-0a6e28cd4c57 was raw, no need to convert to raw {{(pid=87084) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 12:20:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:20:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:20:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:20:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:41 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:20:41 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:42 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.290s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:20:42 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:20:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:20:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:20:50 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:20:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Flow 'volume_create_manager' (522db5f3-fb92-4976-a709-3f1a3566815e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:20:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a0fae3-73cc-4008-8f3b-c18f4536c833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a0fae3-73cc-4008-8f3b-c18f4536c833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1620084815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b221d9-a210-4ebd-9393-6ecbf472e68a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85fcd0985b074cdf9a8269cbb7c18a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:20:50Z,use_quota=True,user_id='24e59567a9eb43c093abc02b55618952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac65ed9-25d5-485f-a744-5d37733f6696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac65ed9-25d5-485f-a744-5d37733f6696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a8ffe5-17c3-46ed-a41b-a101da837ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a8ffe5-17c3-46ed-a41b-a101da837ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b221d9-a210-4ebd-9393-6ecbf472e68a', 'volume_name': 'volume-03b221d9-a210-4ebd-9393-6ecbf472e68a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c45ace-3fb7-431c-bf3f-d92ba13e6bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c45ace-3fb7-431c-bf3f-d92ba13e6bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9f860a-a95c-4cdd-bab5-0ffce0e7c028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:50 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Volume 03b221d9-a210-4ebd-9393-6ecbf472e68a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b221d9-a210-4ebd-9393-6ecbf472e68a', 'volume_size': 1} Sep 01 12:20:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b0709644-c137-402b-b485-62f9f483a07d tempest-TestImageHashVerification-894627395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.800s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:55 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b0709644-c137-402b-b485-62f9f483a07d tempest-TestImageHashVerification-894627395 None] Uploaded volume to glance image-id: ae0e6a45-71ac-418e-9f85-0a6e28cd4c57. {{(pid=87084) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 12:20:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.791s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1620084815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b221d9-a210-4ebd-9393-6ecbf472e68a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85fcd0985b074cdf9a8269cbb7c18a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:20:50Z,use_quota=True,user_id='24e59567a9eb43c093abc02b55618952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:20:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Creating volume 03b221d9-a210-4ebd-9393-6ecbf472e68a {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:20:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:20:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:20:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:55 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:20:55 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:20:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:55 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a 1073741824 Sep 01 12:20:55 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:55 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b0709644-c137-402b-b485-62f9f483a07d tempest-TestImageHashVerification-894627395 None] Copy volume to image completed successfully. Sep 01 12:20:55 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a 1073741824" returned: 0 in 0.439s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:55 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a Sep 01 12:20:55 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:56 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a" returned: 0 in 0.251s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:20:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9f860a-a95c-4cdd-bab5-0ffce0e7c028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b221d9-a210-4ebd-9393-6ecbf472e68a', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cbb675d-d842-4450-a97b-0256d6d1f512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:20:56 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Volume volume-03b221d9-a210-4ebd-9393-6ecbf472e68a (03b221d9-a210-4ebd-9393-6ecbf472e68a): created successfully Sep 01 12:20:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cbb675d-d842-4450-a97b-0256d6d1f512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:20:56 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Flow 'volume_create_manager' (522db5f3-fb92-4976-a709-3f1a3566815e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:20:56 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4825e23a-ba0f-48f0-b3d7-b233010f4305 tempest-SnapshotDependencyTests-1176524909 None] Created volume successfully. Sep 01 12:20:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-abdb2c84-d8f4-441f-a2fc-12ece0600660 tempest-TestImageHashVerification-894627395 None] Acquiring lock "cinder-9cad45e7-c646-40f8-8b74-4d13023b2e01-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-abdb2c84-d8f4-441f-a2fc-12ece0600660 tempest-TestImageHashVerification-894627395 None] Lock "cinder-9cad45e7-c646-40f8-8b74-4d13023b2e01-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-abdb2c84-d8f4-441f-a2fc-12ece0600660 tempest-TestImageHashVerification-894627395 None] Acquiring lock "cinder-quobyte-9cad45e7-c646-40f8-8b74-4d13023b2e01" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:20:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-abdb2c84-d8f4-441f-a2fc-12ece0600660 tempest-TestImageHashVerification-894627395 None] Lock "cinder-quobyte-9cad45e7-c646-40f8-8b74-4d13023b2e01" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:20:56 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[30502855-e93c-4684-8a82-c3d276e8c1b3]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:20:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abdb2c84-d8f4-441f-a2fc-12ece0600660 tempest-TestImageHashVerification-894627395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:56 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01 Sep 01 12:20:56 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7d9c7774-1244-45a4-a355-011a3f2b753f tempest-SnapshotDependencyTests-1176524909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7d9c7774-1244-45a4-a355-011a3f2b753f tempest-SnapshotDependencyTests-1176524909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7d9c7774-1244-45a4-a355-011a3f2b753f tempest-SnapshotDependencyTests-1176524909 None] Creating offline snapshot 18c1ca23-02fc-4b26-a11e-3d5ae7db061b of volume 03b221d9-a210-4ebd-9393-6ecbf472e68a {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9453a8e8-ff2a-4df5-9814-f969e331dbde]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d9c7774-1244-45a4-a355-011a3f2b753f tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:57 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abdb2c84-d8f4-441f-a2fc-12ece0600660 tempest-TestImageHashVerification-894627395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01" returned: 0 in 0.411s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abdb2c84-d8f4-441f-a2fc-12ece0600660 tempest-TestImageHashVerification-894627395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:57 devstack sudo[102698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01 Sep 01 12:20:57 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:57 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a Sep 01 12:20:57 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:57 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abdb2c84-d8f4-441f-a2fc-12ece0600660 tempest-TestImageHashVerification-894627395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-9cad45e7-c646-40f8-8b74-4d13023b2e01" returned: 0 in 0.241s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-abdb2c84-d8f4-441f-a2fc-12ece0600660 tempest-TestImageHashVerification-894627395 None] Lock "cinder-quobyte-9cad45e7-c646-40f8-8b74-4d13023b2e01" released by "delete_volume" :: held 0.698s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-abdb2c84-d8f4-441f-a2fc-12ece0600660 tempest-TestImageHashVerification-894627395 None] Created reservations ['381e00c9-4af0-4805-b10a-306f98f0b91e', 'a68960ac-7ba0-465c-9b6b-03c383e71c78', '74c31496-5170-49a8-aef8-fba23c65268f', '901217ba-6ed2-4066-af9c-921200a39a8a'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:20:57 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d9c7774-1244-45a4-a355-011a3f2b753f tempest-SnapshotDependencyTests-1176524909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a" returned: 0 in 0.375s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d9c7774-1244-45a4-a355-011a3f2b753f tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:57 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b 1G Sep 01 12:20:57 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-abdb2c84-d8f4-441f-a2fc-12ece0600660 tempest-TestImageHashVerification-894627395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-abdb2c84-d8f4-441f-a2fc-12ece0600660 tempest-TestImageHashVerification-894627395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-abdb2c84-d8f4-441f-a2fc-12ece0600660 tempest-TestImageHashVerification-894627395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-abdb2c84-d8f4-441f-a2fc-12ece0600660 tempest-TestImageHashVerification-894627395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-abdb2c84-d8f4-441f-a2fc-12ece0600660 tempest-TestImageHashVerification-894627395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abdb2c84-d8f4-441f-a2fc-12ece0600660 tempest-TestImageHashVerification-894627395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:57 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:20:57 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:57 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-abdb2c84-d8f4-441f-a2fc-12ece0600660 tempest-TestImageHashVerification-894627395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.284s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-abdb2c84-d8f4-441f-a2fc-12ece0600660 tempest-TestImageHashVerification-894627395 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:20:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-abdb2c84-d8f4-441f-a2fc-12ece0600660 tempest-TestImageHashVerification-894627395 None] Deleted volume successfully. Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-abdb2c84-d8f4-441f-a2fc-12ece0600660 tempest-TestImageHashVerification-894627395 None] Lock "cinder-9cad45e7-c646-40f8-8b74-4d13023b2e01-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:20:57 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d9c7774-1244-45a4-a355-011a3f2b753f tempest-SnapshotDependencyTests-1176524909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b 1G" returned: 0 in 0.463s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d9c7774-1244-45a4-a355-011a3f2b753f tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03b221d9-a210-4ebd-9393-6ecbf472e68a -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:57 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03b221d9-a210-4ebd-9393-6ecbf472e68a -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b Sep 01 12:20:57 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:58 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d9c7774-1244-45a4-a355-011a3f2b753f tempest-SnapshotDependencyTests-1176524909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03b221d9-a210-4ebd-9393-6ecbf472e68a -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b" returned: 0 in 0.295s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:58 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-7d9c7774-1244-45a4-a355-011a3f2b753f tempest-SnapshotDependencyTests-1176524909 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b is being set with open permissions: ugo+rw Sep 01 12:20:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d9c7774-1244-45a4-a355-011a3f2b753f tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:58 devstack sudo[102720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b Sep 01 12:20:58 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:58 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d9c7774-1244-45a4-a355-011a3f2b753f tempest-SnapshotDependencyTests-1176524909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b" returned: 0 in 0.291s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d9c7774-1244-45a4-a355-011a3f2b753f tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:58 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.info Sep 01 12:20:58 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:58 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d9c7774-1244-45a4-a355-011a3f2b753f tempest-SnapshotDependencyTests-1176524909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.info" returned: 0 in 0.263s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:58 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-7d9c7774-1244-45a4-a355-011a3f2b753f tempest-SnapshotDependencyTests-1176524909 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.info is being set with open permissions: ugo+rw Sep 01 12:20:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d9c7774-1244-45a4-a355-011a3f2b753f tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:20:58 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.info Sep 01 12:20:58 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:20:59 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Sep 01 12:20:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d9c7774-1244-45a4-a355-011a3f2b753f tempest-SnapshotDependencyTests-1176524909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.info" returned: 0 in 0.241s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:20:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7d9c7774-1244-45a4-a355-011a3f2b753f tempest-SnapshotDependencyTests-1176524909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.031s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:20:59 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7d9c7774-1244-45a4-a355-011a3f2b753f tempest-SnapshotDependencyTests-1176524909 None] Create snapshot completed successfully Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Flow 'volume_create_manager' (722aa84f-a8f1-410c-8ac7-f3412b1c7a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c368b5f4-ecb8-4898-9a6a-6b73ea2ba1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c368b5f4-ecb8-4898-9a6a-6b73ea2ba1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a057ff62-64a5-4e34-8eab-d0c5fae950eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85fcd0985b074cdf9a8269cbb7c18a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=18c1ca23-02fc-4b26-a11e-3d5ae7db061b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:21:01Z,use_quota=True,user_id='24e59567a9eb43c093abc02b55618952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efaede29-8174-4083-8d1c-9a755dd635f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efaede29-8174-4083-8d1c-9a755dd635f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74a1a00a-d4ee-4083-a67f-fd2c45e468c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74a1a00a-d4ee-4083-a67f-fd2c45e468c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a057ff62-64a5-4e34-8eab-d0c5fae950eb', 'volume_name': 'volume-a057ff62-64a5-4e34-8eab-d0c5fae950eb', 'volume_size': 1, 'snapshot_id': '18c1ca23-02fc-4b26-a11e-3d5ae7db061b'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a21b85-ae7a-4864-ac7d-6322686cc936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a21b85-ae7a-4864-ac7d-6322686cc936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (997ade2d-ddc5-4971-b723-cec83ea71b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:21:00 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Volume a057ff62-64a5-4e34-8eab-d0c5fae950eb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a057ff62-64a5-4e34-8eab-d0c5fae950eb', 'volume_size': 1, 'snapshot_id': '18c1ca23-02fc-4b26-a11e-3d5ae7db061b'} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Acquiring lock "cinder-quobyte-18c1ca23-02fc-4b26-a11e-3d5ae7db061b-a057ff62-64a5-4e34-8eab-d0c5fae950eb" by "_create_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Lock "cinder-quobyte-18c1ca23-02fc-4b26-a11e-3d5ae7db061b-a057ff62-64a5-4e34-8eab-d0c5fae950eb" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Creating volume a057ff62-64a5-4e34-8eab-d0c5fae950eb from snapshot 18c1ca23-02fc-4b26-a11e-3d5ae7db061b {{(pid=87084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Acquiring lock "cinder-quobyte-a057ff62-64a5-4e34-8eab-d0c5fae950eb" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Lock "cinder-quobyte-a057ff62-64a5-4e34-8eab-d0c5fae950eb" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] snapshot: 18c1ca23-02fc-4b26-a11e-3d5ae7db061b, volume: a057ff62-64a5-4e34-8eab-d0c5fae950eb, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e776293d-9269-4dad-a05a-9184aea52cdc]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:21:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:21:01 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b Sep 01 12:21:01 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:21:01 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Sep 01 12:21:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b" returned: 0 in 0.409s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:21:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03b221d9-a210-4ebd-9393-6ecbf472e68a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:21:01 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9ee1b3-7705-493d-ba48-17ccc7ef2d1b]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:21:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:21:01 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a Sep 01 12:21:01 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:21:01 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Sep 01 12:21:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a" returned: 0 in 0.404s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:21:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:21:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:21:01 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Path /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a057ff62-64a5-4e34-8eab-d0c5fae950eb not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:21:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a057ff62-64a5-4e34-8eab-d0c5fae950eb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:21:01 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a057ff62-64a5-4e34-8eab-d0c5fae950eb Sep 01 12:21:01 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:21:06 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Sep 01 12:21:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a057ff62-64a5-4e34-8eab-d0c5fae950eb" returned: 0 in 4.826s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:21:06 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a, size 1024.00 MB, duration 4.83 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a057ff62-64a5-4e34-8eab-d0c5fae950eb {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:21:06 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Converted 1024.00 MB image at 212.12 MB/s Sep 01 12:21:06 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a057ff62-64a5-4e34-8eab-d0c5fae950eb is being set with open permissions: ugo+rw Sep 01 12:21:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a057ff62-64a5-4e34-8eab-d0c5fae950eb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:21:06 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a057ff62-64a5-4e34-8eab-d0c5fae950eb Sep 01 12:21:06 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:21:06 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Sep 01 12:21:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a057ff62-64a5-4e34-8eab-d0c5fae950eb" returned: 0 in 0.275s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:21:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Lock "cinder-quobyte-a057ff62-64a5-4e34-8eab-d0c5fae950eb" released by "_copy_volume_from_snapshot" :: held 6.000s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:21:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Lock "cinder-quobyte-18c1ca23-02fc-4b26-a11e-3d5ae7db061b-a057ff62-64a5-4e34-8eab-d0c5fae950eb" released by "_create_volume_from_snapshot" :: held 6.073s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:21:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.088s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:21:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (997ade2d-ddc5-4971-b723-cec83ea71b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a057ff62-64a5-4e34-8eab-d0c5fae950eb', 'volume_size': 1, 'snapshot_id': '18c1ca23-02fc-4b26-a11e-3d5ae7db061b'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:21:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (febed8cd-8b55-4db1-a642-505eca222490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:21:07 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Volume volume-a057ff62-64a5-4e34-8eab-d0c5fae950eb (a057ff62-64a5-4e34-8eab-d0c5fae950eb): created successfully Sep 01 12:21:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (febed8cd-8b55-4db1-a642-505eca222490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:21:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Flow 'volume_create_manager' (722aa84f-a8f1-410c-8ac7-f3412b1c7a7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:21:07 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0eb8cb0e-28b3-4730-80eb-3217cc10699d tempest-SnapshotDependencyTests-1176524909 None] Created volume successfully. Sep 01 12:21:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] Acquiring lock "cinder-18c1ca23-02fc-4b26-a11e-3d5ae7db061b-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:21:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] Lock "cinder-18c1ca23-02fc-4b26-a11e-3d5ae7db061b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:21:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] Acquiring lock "cinder-quobyte-03b221d9-a210-4ebd-9393-6ecbf472e68a" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:21:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] Lock "cinder-quobyte-03b221d9-a210-4ebd-9393-6ecbf472e68a" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:21:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] Acquiring lock "cinder-quobyte-18c1ca23-02fc-4b26-a11e-3d5ae7db061b" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:21:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] Lock "cinder-quobyte-18c1ca23-02fc-4b26-a11e-3d5ae7db061b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:21:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] Deleting offline snapshot 18c1ca23-02fc-4b26-a11e-3d5ae7db061b of volume 03b221d9-a210-4ebd-9393-6ecbf472e68a {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:21:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] snapshot_file for this snap is: volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:21:07 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[647a2117-a2d8-4a17-b52a-54a9c8eddff0]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:21:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:21:07 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b Sep 01 12:21:07 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:21:08 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Sep 01 12:21:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b" returned: 0 in 0.381s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:21:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03b221d9-a210-4ebd-9393-6ecbf472e68a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:21:08 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8322916f-b1a9-4562-9731-42bcbca9e818]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:21:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:21:08 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a Sep 01 12:21:08 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:21:08 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Sep 01 12:21:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a" returned: 0 in 0.624s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:21:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:21:08 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b Sep 01 12:21:08 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:21:09 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Sep 01 12:21:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b" returned: 0 in 0.349s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:21:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:21:09 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b Sep 01 12:21:09 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:21:09 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Sep 01 12:21:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a.18c1ca23-02fc-4b26-a11e-3d5ae7db061b" returned: 0 in 0.260s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:21:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] Lock "cinder-quobyte-18c1ca23-02fc-4b26-a11e-3d5ae7db061b" released by "_delete_snapshot" :: held 1.732s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:21:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] Lock "cinder-quobyte-03b221d9-a210-4ebd-9393-6ecbf472e68a" released by "delete_snapshot" :: held 1.759s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:21:09 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] Created reservations ['161e9a32-9f33-4f4b-abed-38a404250d39', '46a29a5e-a4b0-413a-8143-d080d8c78eb5', '7e4ee9f4-1c91-4c9b-826c-c14ba8fd0c9e', '719b447c-f70b-4bd4-a4ea-21b51727b904'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:21:09 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] Delete snapshot completed successfully. Sep 01 12:21:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-560204fc-c836-4750-8d2b-dec72481d58f tempest-SnapshotDependencyTests-1176524909 None] Lock "cinder-18c1ca23-02fc-4b26-a11e-3d5ae7db061b-delete_snapshot" released by "delete_snapshot" :: held 1.931s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:21:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1f7569db-f8b4-42e7-bcb2-e5f237b01655 tempest-SnapshotDependencyTests-1176524909 None] Acquiring lock "cinder-03b221d9-a210-4ebd-9393-6ecbf472e68a-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:21:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1f7569db-f8b4-42e7-bcb2-e5f237b01655 tempest-SnapshotDependencyTests-1176524909 None] Lock "cinder-03b221d9-a210-4ebd-9393-6ecbf472e68a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:21:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1f7569db-f8b4-42e7-bcb2-e5f237b01655 tempest-SnapshotDependencyTests-1176524909 None] Acquiring lock "cinder-quobyte-03b221d9-a210-4ebd-9393-6ecbf472e68a" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:21:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1f7569db-f8b4-42e7-bcb2-e5f237b01655 tempest-SnapshotDependencyTests-1176524909 None] Lock "cinder-quobyte-03b221d9-a210-4ebd-9393-6ecbf472e68a" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:21:10 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a71a14-99f9-423b-a319-30c0598ae79e]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:21:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f7569db-f8b4-42e7-bcb2-e5f237b01655 tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:21:10 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a Sep 01 12:21:10 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:21:10 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Sep 01 12:21:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f7569db-f8b4-42e7-bcb2-e5f237b01655 tempest-SnapshotDependencyTests-1176524909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a" returned: 0 in 0.450s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:21:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f7569db-f8b4-42e7-bcb2-e5f237b01655 tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:21:10 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a Sep 01 12:21:10 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:21:10 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Sep 01 12:21:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f7569db-f8b4-42e7-bcb2-e5f237b01655 tempest-SnapshotDependencyTests-1176524909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-03b221d9-a210-4ebd-9393-6ecbf472e68a" returned: 0 in 0.269s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:21:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1f7569db-f8b4-42e7-bcb2-e5f237b01655 tempest-SnapshotDependencyTests-1176524909 None] Lock "cinder-quobyte-03b221d9-a210-4ebd-9393-6ecbf472e68a" released by "delete_volume" :: held 0.788s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:21:10 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-1f7569db-f8b4-42e7-bcb2-e5f237b01655 tempest-SnapshotDependencyTests-1176524909 None] Created reservations ['286d9a64-0d93-4365-b040-20cde28c4417', 'e80a61ff-0124-4414-816c-bcf861189371', '6c66f345-6d88-4f7b-ba62-59d376d30732', '95efa76d-36ea-43d1-bd8e-cdced98d4861'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:21:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f7569db-f8b4-42e7-bcb2-e5f237b01655 tempest-SnapshotDependencyTests-1176524909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:21:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f7569db-f8b4-42e7-bcb2-e5f237b01655 tempest-SnapshotDependencyTests-1176524909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:21:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1f7569db-f8b4-42e7-bcb2-e5f237b01655 tempest-SnapshotDependencyTests-1176524909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:21:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1f7569db-f8b4-42e7-bcb2-e5f237b01655 tempest-SnapshotDependencyTests-1176524909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:21:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1f7569db-f8b4-42e7-bcb2-e5f237b01655 tempest-SnapshotDependencyTests-1176524909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:21:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f7569db-f8b4-42e7-bcb2-e5f237b01655 tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:21:10 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:21:10 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:21:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1b820d7a-bba4-435e-b064-497a2b14cfd7 tempest-SnapshotDependencyTests-1176524909 None] Acquiring lock "cinder-a057ff62-64a5-4e34-8eab-d0c5fae950eb-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:21:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1b820d7a-bba4-435e-b064-497a2b14cfd7 tempest-SnapshotDependencyTests-1176524909 None] Lock "cinder-a057ff62-64a5-4e34-8eab-d0c5fae950eb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:21:11 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Sep 01 12:21:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1b820d7a-bba4-435e-b064-497a2b14cfd7 tempest-SnapshotDependencyTests-1176524909 None] Acquiring lock "cinder-quobyte-a057ff62-64a5-4e34-8eab-d0c5fae950eb" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:21:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1f7569db-f8b4-42e7-bcb2-e5f237b01655 tempest-SnapshotDependencyTests-1176524909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.296s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:21:11 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-1f7569db-f8b4-42e7-bcb2-e5f237b01655 tempest-SnapshotDependencyTests-1176524909 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:21:11 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1f7569db-f8b4-42e7-bcb2-e5f237b01655 tempest-SnapshotDependencyTests-1176524909 None] Deleted volume successfully. Sep 01 12:21:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1b820d7a-bba4-435e-b064-497a2b14cfd7 tempest-SnapshotDependencyTests-1176524909 None] Lock "cinder-quobyte-a057ff62-64a5-4e34-8eab-d0c5fae950eb" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:21:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1f7569db-f8b4-42e7-bcb2-e5f237b01655 tempest-SnapshotDependencyTests-1176524909 None] Lock "cinder-03b221d9-a210-4ebd-9393-6ecbf472e68a-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:21:11 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[167b823b-8cfe-4b1c-8ad5-08148fda51fc]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:21:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1b820d7a-bba4-435e-b064-497a2b14cfd7 tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a057ff62-64a5-4e34-8eab-d0c5fae950eb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:21:11 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a057ff62-64a5-4e34-8eab-d0c5fae950eb Sep 01 12:21:11 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:21:11 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Sep 01 12:21:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1b820d7a-bba4-435e-b064-497a2b14cfd7 tempest-SnapshotDependencyTests-1176524909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a057ff62-64a5-4e34-8eab-d0c5fae950eb" returned: 0 in 0.367s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:21:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1b820d7a-bba4-435e-b064-497a2b14cfd7 tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a057ff62-64a5-4e34-8eab-d0c5fae950eb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:21:11 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a057ff62-64a5-4e34-8eab-d0c5fae950eb Sep 01 12:21:11 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:21:11 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Sep 01 12:21:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1b820d7a-bba4-435e-b064-497a2b14cfd7 tempest-SnapshotDependencyTests-1176524909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a057ff62-64a5-4e34-8eab-d0c5fae950eb" returned: 0 in 0.254s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:21:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1b820d7a-bba4-435e-b064-497a2b14cfd7 tempest-SnapshotDependencyTests-1176524909 None] Lock "cinder-quobyte-a057ff62-64a5-4e34-8eab-d0c5fae950eb" released by "delete_volume" :: held 0.665s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:21:11 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-1b820d7a-bba4-435e-b064-497a2b14cfd7 tempest-SnapshotDependencyTests-1176524909 None] Created reservations ['b01e3917-56b8-4e60-a222-f11b18e5e54b', '622dd5f1-bcba-4899-9313-000f880054e5', 'cf5ad2e0-10a3-4651-9ccf-7608724460aa', '99761208-c029-44e9-aae8-53a2e2615ad6'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:21:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1b820d7a-bba4-435e-b064-497a2b14cfd7 tempest-SnapshotDependencyTests-1176524909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:21:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1b820d7a-bba4-435e-b064-497a2b14cfd7 tempest-SnapshotDependencyTests-1176524909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:21:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1b820d7a-bba4-435e-b064-497a2b14cfd7 tempest-SnapshotDependencyTests-1176524909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:21:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1b820d7a-bba4-435e-b064-497a2b14cfd7 tempest-SnapshotDependencyTests-1176524909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:21:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1b820d7a-bba4-435e-b064-497a2b14cfd7 tempest-SnapshotDependencyTests-1176524909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:21:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1b820d7a-bba4-435e-b064-497a2b14cfd7 tempest-SnapshotDependencyTests-1176524909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:21:12 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:21:12 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:21:12 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Sep 01 12:21:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1b820d7a-bba4-435e-b064-497a2b14cfd7 tempest-SnapshotDependencyTests-1176524909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.261s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:21:12 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-1b820d7a-bba4-435e-b064-497a2b14cfd7 tempest-SnapshotDependencyTests-1176524909 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:21:12 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1b820d7a-bba4-435e-b064-497a2b14cfd7 tempest-SnapshotDependencyTests-1176524909 None] Deleted volume successfully. Sep 01 12:21:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1b820d7a-bba4-435e-b064-497a2b14cfd7 tempest-SnapshotDependencyTests-1176524909 None] Lock "cinder-a057ff62-64a5-4e34-8eab-d0c5fae950eb-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:21:22 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=39,cinder:SELECT=27,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:21:22 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=33,cinder:UPDATE=36,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Flow 'volume_create_manager' (ff4f1015-3b5b-4295-848c-0dd4f0b238d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acfa4f52-9187-4ecb-b88e-e7f7f099b7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acfa4f52-9187-4ecb-b88e-e7f7f099b7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-220934403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac7f9b1f-5110-45e6-bd31-97824b836b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a00feb0b764ce8a0c6fd78e5c63fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:21:33Z,use_quota=True,user_id='ef23bd2a42cc4d16a4d98f12868db9cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee63f4e1-5b75-4300-81aa-d4862bec5677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee63f4e1-5b75-4300-81aa-d4862bec5677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333a0d8a-2b30-4631-928c-de85bd05b73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333a0d8a-2b30-4631-928c-de85bd05b73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac7f9b1f-5110-45e6-bd31-97824b836b41', 'volume_name': 'volume-ac7f9b1f-5110-45e6-bd31-97824b836b41', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdd59e2-af89-4d63-b002-b2795fb4bc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdd59e2-af89-4d63-b002-b2795fb4bc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73de0a38-d33b-41a0-be81-fc26800d29cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:21:32 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Volume ac7f9b1f-5110-45e6-bd31-97824b836b41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac7f9b1f-5110-45e6-bd31-97824b836b41', 'volume_size': 1} Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-220934403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac7f9b1f-5110-45e6-bd31-97824b836b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a00feb0b764ce8a0c6fd78e5c63fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:21:33Z,use_quota=True,user_id='ef23bd2a42cc4d16a4d98f12868db9cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Creating volume ac7f9b1f-5110-45e6-bd31-97824b836b41 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:21:32 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:21:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:21:32 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 1073741824 Sep 01 12:21:32 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:21:33 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Sep 01 12:21:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 1073741824" returned: 0 in 0.435s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:21:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:21:33 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 Sep 01 12:21:33 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:21:33 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Sep 01 12:21:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41" returned: 0 in 0.269s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:21:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:21:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:21:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73de0a38-d33b-41a0-be81-fc26800d29cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac7f9b1f-5110-45e6-bd31-97824b836b41', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:21:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6bd3fb3-ec7e-40bf-8847-13f0520fedf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:21:33 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Volume volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 (ac7f9b1f-5110-45e6-bd31-97824b836b41): created successfully Sep 01 12:21:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6bd3fb3-ec7e-40bf-8847-13f0520fedf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:21:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Flow 'volume_create_manager' (ff4f1015-3b5b-4295-848c-0dd4f0b238d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:21:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-04e7ee0b-da92-4099-8529-964bfc4cd819 tempest-TestStampPattern-2092672715 None] Created volume successfully. Sep 01 12:21:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:21:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:21:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:21:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:21:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:21:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:21:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:21:41 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:21:41 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:21:42 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Sep 01 12:21:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.306s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:21:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:21:42 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:21:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:21:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:21:43 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:INSERT=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:21:43 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:22:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-78b7715a-ba19-42e5-8012-7ffa841e5fb1 req-3f121404-16f5-4e73-9ebe-726020cc13f5 tempest-TestStampPattern-2092672715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:22:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-78b7715a-ba19-42e5-8012-7ffa841e5fb1 req-3f121404-16f5-4e73-9ebe-726020cc13f5 tempest-TestStampPattern-2092672715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:22:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-78b7715a-ba19-42e5-8012-7ffa841e5fb1 req-3f121404-16f5-4e73-9ebe-726020cc13f5 tempest-TestStampPattern-2092672715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:22:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-78b7715a-ba19-42e5-8012-7ffa841e5fb1 req-3f121404-16f5-4e73-9ebe-726020cc13f5 tempest-TestStampPattern-2092672715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-ac7f9b1f-5110-45e6-bd31-97824b836b41', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c5a0caa-de71-4d2c-b156-822065d305bf', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:22:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-78b7715a-ba19-42e5-8012-7ffa841e5fb1 req-3f121404-16f5-4e73-9ebe-726020cc13f5 tempest-TestStampPattern-2092672715 None] attachment_update completed successfully. Sep 01 12:22:06 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-a27d5570-7fd8-4d47-a06b-ed8071f3f19c req-19664727-28b3-48d2-85be-cebbfbdec5cb tempest-TestStampPattern-2092672715 None] Terminate volume connection completed successfully. Sep 01 12:22:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-a27d5570-7fd8-4d47-a06b-ed8071f3f19c req-19664727-28b3-48d2-85be-cebbfbdec5cb tempest-TestStampPattern-2092672715 None] Deleting attachment 6c5a0caa-de71-4d2c-b156-822065d305bf. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:22:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8ae782f9-24b6-4617-83d6-36bf24e1531a tempest-TestStampPattern-2092672715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:22:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8ae782f9-24b6-4617-83d6-36bf24e1531a tempest-TestStampPattern-2092672715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:22:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-8ae782f9-24b6-4617-83d6-36bf24e1531a tempest-TestStampPattern-2092672715 None] Creating offline snapshot 6129a1e2-ff56-4ec0-9038-2e290a9920eb of volume ac7f9b1f-5110-45e6-bd31-97824b836b41 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:22:07 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[067210ce-17e7-492c-b05c-2752482d0925]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:22:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8ae782f9-24b6-4617-83d6-36bf24e1531a tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:22:07 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 Sep 01 12:22:07 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:22:07 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Sep 01 12:22:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8ae782f9-24b6-4617-83d6-36bf24e1531a tempest-TestStampPattern-2092672715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41" returned: 0 in 0.350s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:22:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8ae782f9-24b6-4617-83d6-36bf24e1531a tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:22:08 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb 1G Sep 01 12:22:08 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:22:08 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Sep 01 12:22:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8ae782f9-24b6-4617-83d6-36bf24e1531a tempest-TestStampPattern-2092672715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb 1G" returned: 0 in 0.376s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:22:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8ae782f9-24b6-4617-83d6-36bf24e1531a tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:22:08 devstack sudo[103434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb Sep 01 12:22:08 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:22:08 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root Sep 01 12:22:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8ae782f9-24b6-4617-83d6-36bf24e1531a tempest-TestStampPattern-2092672715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb" returned: 0 in 0.280s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:22:08 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-8ae782f9-24b6-4617-83d6-36bf24e1531a tempest-TestStampPattern-2092672715 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb is being set with open permissions: ugo+rw Sep 01 12:22:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8ae782f9-24b6-4617-83d6-36bf24e1531a tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:22:08 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb Sep 01 12:22:08 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:22:08 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Sep 01 12:22:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8ae782f9-24b6-4617-83d6-36bf24e1531a tempest-TestStampPattern-2092672715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb" returned: 0 in 0.234s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:22:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8ae782f9-24b6-4617-83d6-36bf24e1531a tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:22:08 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.info Sep 01 12:22:08 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:22:09 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Sep 01 12:22:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8ae782f9-24b6-4617-83d6-36bf24e1531a tempest-TestStampPattern-2092672715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.info" returned: 0 in 0.239s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:22:09 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-8ae782f9-24b6-4617-83d6-36bf24e1531a tempest-TestStampPattern-2092672715 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.info is being set with open permissions: ugo+rw Sep 01 12:22:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8ae782f9-24b6-4617-83d6-36bf24e1531a tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:22:09 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.info Sep 01 12:22:09 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:22:09 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Sep 01 12:22:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8ae782f9-24b6-4617-83d6-36bf24e1531a tempest-TestStampPattern-2092672715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.info" returned: 0 in 0.231s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:22:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8ae782f9-24b6-4617-83d6-36bf24e1531a tempest-TestStampPattern-2092672715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.843s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:22:09 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8ae782f9-24b6-4617-83d6-36bf24e1531a tempest-TestStampPattern-2092672715 None] Create snapshot completed successfully Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Flow 'volume_create_manager' (ebf31af3-0ca6-4b72-8c1a-d0f5f182e166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98999288-3964-458f-942c-6e7b91c70409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98999288-3964-458f-942c-6e7b91c70409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1735910581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc24858a-24dd-40d1-945a-2c4fc3437c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a00feb0b764ce8a0c6fd78e5c63fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6129a1e2-ff56-4ec0-9038-2e290a9920eb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:22:15Z,use_quota=True,user_id='ef23bd2a42cc4d16a4d98f12868db9cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2bc7b8-6769-466d-9a45-86d9f26236a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2bc7b8-6769-466d-9a45-86d9f26236a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f151cb0-5358-4569-8290-8575380a2baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f151cb0-5358-4569-8290-8575380a2baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bc24858a-24dd-40d1-945a-2c4fc3437c57', 'volume_name': 'volume-bc24858a-24dd-40d1-945a-2c4fc3437c57', 'volume_size': 1, 'snapshot_id': '6129a1e2-ff56-4ec0-9038-2e290a9920eb'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5b9e1c-e8e0-4830-b0d8-18c6d6b600ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5b9e1c-e8e0-4830-b0d8-18c6d6b600ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17006f85-00f6-4a11-9d12-56b8cb92f1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:22:15 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Volume bc24858a-24dd-40d1-945a-2c4fc3437c57: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bc24858a-24dd-40d1-945a-2c4fc3437c57', 'volume_size': 1, 'snapshot_id': '6129a1e2-ff56-4ec0-9038-2e290a9920eb'} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Acquiring lock "cinder-quobyte-6129a1e2-ff56-4ec0-9038-2e290a9920eb-bc24858a-24dd-40d1-945a-2c4fc3437c57" by "_create_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Lock "cinder-quobyte-6129a1e2-ff56-4ec0-9038-2e290a9920eb-bc24858a-24dd-40d1-945a-2c4fc3437c57" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Creating volume bc24858a-24dd-40d1-945a-2c4fc3437c57 from snapshot 6129a1e2-ff56-4ec0-9038-2e290a9920eb {{(pid=87084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Acquiring lock "cinder-quobyte-bc24858a-24dd-40d1-945a-2c4fc3437c57" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Lock "cinder-quobyte-bc24858a-24dd-40d1-945a-2c4fc3437c57" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] snapshot: 6129a1e2-ff56-4ec0-9038-2e290a9920eb, volume: bc24858a-24dd-40d1-945a-2c4fc3437c57, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b964e7c1-56ea-4c9d-af72-3d86057994db]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:22:15 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb Sep 01 12:22:15 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:22:15 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb" returned: 0 in 0.375s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac7f9b1f-5110-45e6-bd31-97824b836b41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fbdca6-98d0-4b96-810b-81fd1c5519bd]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:22:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:22:15 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 Sep 01 12:22:15 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:22:16 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Sep 01 12:22:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41" returned: 0 in 0.379s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:22:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:22:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:22:16 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Path /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc24858a-24dd-40d1-945a-2c4fc3437c57 not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:22:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc24858a-24dd-40d1-945a-2c4fc3437c57 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:22:16 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc24858a-24dd-40d1-945a-2c4fc3437c57 Sep 01 12:22:16 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:22:21 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Sep 01 12:22:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc24858a-24dd-40d1-945a-2c4fc3437c57" returned: 0 in 5.378s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:22:21 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41, size 1024.00 MB, duration 5.38 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc24858a-24dd-40d1-945a-2c4fc3437c57 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:22:21 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Converted 1024.00 MB image at 190.35 MB/s Sep 01 12:22:21 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc24858a-24dd-40d1-945a-2c4fc3437c57 is being set with open permissions: ugo+rw Sep 01 12:22:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc24858a-24dd-40d1-945a-2c4fc3437c57 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:22:21 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc24858a-24dd-40d1-945a-2c4fc3437c57 Sep 01 12:22:21 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:22:21 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Sep 01 12:22:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc24858a-24dd-40d1-945a-2c4fc3437c57" returned: 0 in 0.290s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:22:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Lock "cinder-quobyte-bc24858a-24dd-40d1-945a-2c4fc3437c57" released by "_copy_volume_from_snapshot" :: held 6.522s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:22:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Lock "cinder-quobyte-6129a1e2-ff56-4ec0-9038-2e290a9920eb-bc24858a-24dd-40d1-945a-2c4fc3437c57" released by "_create_volume_from_snapshot" :: held 6.598s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:22:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.614s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:22:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17006f85-00f6-4a11-9d12-56b8cb92f1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc24858a-24dd-40d1-945a-2c4fc3437c57', 'volume_size': 1, 'snapshot_id': '6129a1e2-ff56-4ec0-9038-2e290a9920eb'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:22:21 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d321b75a-e2bd-45e3-bbbf-81c1ba172c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:22:22 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Volume volume-bc24858a-24dd-40d1-945a-2c4fc3437c57 (bc24858a-24dd-40d1-945a-2c4fc3437c57): created successfully Sep 01 12:22:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d321b75a-e2bd-45e3-bbbf-81c1ba172c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:22:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Flow 'volume_create_manager' (ebf31af3-0ca6-4b72-8c1a-d0f5f182e166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:22:22 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b76a7ba1-152e-4107-92d8-f5cf3ba3ae66 tempest-TestStampPattern-2092672715 None] Created volume successfully. Sep 01 12:22:32 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=18,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:22:32 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=12,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:22:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:22:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:22:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:22:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:22:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:22:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:22:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:22:41 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:22:41 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:22:42 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Sep 01 12:22:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.231s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:22:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:22:42 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:22:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:22:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:23:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-c3b2bb3d-aa0e-4033-a6b5-4ae63e7923e3 req-d45e29d9-bf35-4a2f-9052-3d7fad13fac0 tempest-TestStampPattern-2092672715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-c3b2bb3d-aa0e-4033-a6b5-4ae63e7923e3 req-d45e29d9-bf35-4a2f-9052-3d7fad13fac0 tempest-TestStampPattern-2092672715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [req-c3b2bb3d-aa0e-4033-a6b5-4ae63e7923e3 req-d45e29d9-bf35-4a2f-9052-3d7fad13fac0 tempest-TestStampPattern-2092672715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-c3b2bb3d-aa0e-4033-a6b5-4ae63e7923e3 req-d45e29d9-bf35-4a2f-9052-3d7fad13fac0 tempest-TestStampPattern-2092672715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1', 'name': 'volume-bc24858a-24dd-40d1-945a-2c4fc3437c57', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b25b983e-6ad1-4b6b-800b-2f0b98772cf6', 'enforce_multipath': True} {{(pid=87084) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:23:04 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-c3b2bb3d-aa0e-4033-a6b5-4ae63e7923e3 req-d45e29d9-bf35-4a2f-9052-3d7fad13fac0 tempest-TestStampPattern-2092672715 None] attachment_update completed successfully. Sep 01 12:23:06 devstack cinder-volume[87084]: INFO cinder.volume.manager [req-3dc451e8-1d03-406c-bbcc-3d5e0d578238 req-29030e53-b311-4337-9557-2f97928c01a9 tempest-TestStampPattern-2092672715 None] Terminate volume connection completed successfully. Sep 01 12:23:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [req-3dc451e8-1d03-406c-bbcc-3d5e0d578238 req-29030e53-b311-4337-9557-2f97928c01a9 tempest-TestStampPattern-2092672715 None] Deleting attachment b25b983e-6ad1-4b6b-800b-2f0b98772cf6. {{(pid=87084) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:23:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4c899e34-97e0-47ef-b82b-0f99a91f4a3c tempest-TestStampPattern-2092672715 None] Acquiring lock "cinder-bc24858a-24dd-40d1-945a-2c4fc3437c57-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4c899e34-97e0-47ef-b82b-0f99a91f4a3c tempest-TestStampPattern-2092672715 None] Lock "cinder-bc24858a-24dd-40d1-945a-2c4fc3437c57-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4c899e34-97e0-47ef-b82b-0f99a91f4a3c tempest-TestStampPattern-2092672715 None] Acquiring lock "cinder-quobyte-bc24858a-24dd-40d1-945a-2c4fc3437c57" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4c899e34-97e0-47ef-b82b-0f99a91f4a3c tempest-TestStampPattern-2092672715 None] Lock "cinder-quobyte-bc24858a-24dd-40d1-945a-2c4fc3437c57" acquired by "delete_volume" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:10 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02c3945-deef-4753-ba17-77f6955e4b7d]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:23:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4c899e34-97e0-47ef-b82b-0f99a91f4a3c tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc24858a-24dd-40d1-945a-2c4fc3437c57 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:10 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc24858a-24dd-40d1-945a-2c4fc3437c57 Sep 01 12:23:10 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:11 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4c899e34-97e0-47ef-b82b-0f99a91f4a3c tempest-TestStampPattern-2092672715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc24858a-24dd-40d1-945a-2c4fc3437c57" returned: 0 in 0.341s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4c899e34-97e0-47ef-b82b-0f99a91f4a3c tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc24858a-24dd-40d1-945a-2c4fc3437c57 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:11 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc24858a-24dd-40d1-945a-2c4fc3437c57 Sep 01 12:23:11 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:11 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4c899e34-97e0-47ef-b82b-0f99a91f4a3c tempest-TestStampPattern-2092672715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bc24858a-24dd-40d1-945a-2c4fc3437c57" returned: 0 in 0.240s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4c899e34-97e0-47ef-b82b-0f99a91f4a3c tempest-TestStampPattern-2092672715 None] Lock "cinder-quobyte-bc24858a-24dd-40d1-945a-2c4fc3437c57" released by "delete_volume" :: held 0.616s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:11 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-4c899e34-97e0-47ef-b82b-0f99a91f4a3c tempest-TestStampPattern-2092672715 None] Created reservations ['7b217dba-b822-4ae9-ae8f-688f59dfbd6b', 'f65809c5-4e47-46b2-b6c5-522d0d6b7b8b', 'c6b56e7c-0917-42cf-a7dd-2c0ba0906f1c', 'dc2537df-df4a-4aff-8904-a1a4985149b6'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:23:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4c899e34-97e0-47ef-b82b-0f99a91f4a3c tempest-TestStampPattern-2092672715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4c899e34-97e0-47ef-b82b-0f99a91f4a3c tempest-TestStampPattern-2092672715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4c899e34-97e0-47ef-b82b-0f99a91f4a3c tempest-TestStampPattern-2092672715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4c899e34-97e0-47ef-b82b-0f99a91f4a3c tempest-TestStampPattern-2092672715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4c899e34-97e0-47ef-b82b-0f99a91f4a3c tempest-TestStampPattern-2092672715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4c899e34-97e0-47ef-b82b-0f99a91f4a3c tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:11 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:23:11 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:11 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4c899e34-97e0-47ef-b82b-0f99a91f4a3c tempest-TestStampPattern-2092672715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.237s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:11 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-4c899e34-97e0-47ef-b82b-0f99a91f4a3c tempest-TestStampPattern-2092672715 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:23:11 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4c899e34-97e0-47ef-b82b-0f99a91f4a3c tempest-TestStampPattern-2092672715 None] Deleted volume successfully. Sep 01 12:23:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4c899e34-97e0-47ef-b82b-0f99a91f4a3c tempest-TestStampPattern-2092672715 None] Lock "cinder-bc24858a-24dd-40d1-945a-2c4fc3437c57-delete_volume" released by "delete_volume" :: held 1.033s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] Acquiring lock "cinder-6129a1e2-ff56-4ec0-9038-2e290a9920eb-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] Lock "cinder-6129a1e2-ff56-4ec0-9038-2e290a9920eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] Acquiring lock "cinder-quobyte-ac7f9b1f-5110-45e6-bd31-97824b836b41" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] Lock "cinder-quobyte-ac7f9b1f-5110-45e6-bd31-97824b836b41" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] Acquiring lock "cinder-quobyte-6129a1e2-ff56-4ec0-9038-2e290a9920eb" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] Lock "cinder-quobyte-6129a1e2-ff56-4ec0-9038-2e290a9920eb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] Deleting offline snapshot 6129a1e2-ff56-4ec0-9038-2e290a9920eb of volume ac7f9b1f-5110-45e6-bd31-97824b836b41 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:23:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] snapshot_file for this snap is: volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:23:12 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ade7d2-bd89-4f3f-82bd-fb80acf52258]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:23:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:12 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb Sep 01 12:23:12 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:12 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb" returned: 0 in 0.338s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac7f9b1f-5110-45e6-bd31-97824b836b41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:23:12 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c6d5a5-efba-4de9-a02d-054a486ac456]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:23:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:12 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 Sep 01 12:23:12 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:13 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41" returned: 0 in 0.499s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:13 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb Sep 01 12:23:13 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:13 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb" returned: 0 in 0.334s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:13 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb Sep 01 12:23:13 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:13 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41.6129a1e2-ff56-4ec0-9038-2e290a9920eb" returned: 0 in 0.252s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] Lock "cinder-quobyte-6129a1e2-ff56-4ec0-9038-2e290a9920eb" released by "_delete_snapshot" :: held 1.519s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] Lock "cinder-quobyte-ac7f9b1f-5110-45e6-bd31-97824b836b41" released by "delete_snapshot" :: held 1.542s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:13 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] Created reservations ['0b28f159-795b-40c2-9172-5e907a1ca792', '8799d325-b877-426a-9007-abe3290ccf5c', '7cdbe935-6d49-4209-8c16-3b83aace7935', '78ed2a29-e1bb-4807-99f7-9523d8e11384'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:23:13 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] Delete snapshot completed successfully. Sep 01 12:23:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9570dab2-b9c6-4a72-b480-4860fa9373f4 tempest-TestStampPattern-2092672715 None] Lock "cinder-6129a1e2-ff56-4ec0-9038-2e290a9920eb-delete_snapshot" released by "delete_snapshot" :: held 1.669s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-feacbe99-5093-4054-9928-7eb070eca50c tempest-TestStampPattern-2092672715 None] Acquiring lock "cinder-ac7f9b1f-5110-45e6-bd31-97824b836b41-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-feacbe99-5093-4054-9928-7eb070eca50c tempest-TestStampPattern-2092672715 None] Lock "cinder-ac7f9b1f-5110-45e6-bd31-97824b836b41-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-feacbe99-5093-4054-9928-7eb070eca50c tempest-TestStampPattern-2092672715 None] Acquiring lock "cinder-quobyte-ac7f9b1f-5110-45e6-bd31-97824b836b41" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-feacbe99-5093-4054-9928-7eb070eca50c tempest-TestStampPattern-2092672715 None] Lock "cinder-quobyte-ac7f9b1f-5110-45e6-bd31-97824b836b41" acquired by "delete_volume" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:17 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[38585483-6bb8-4534-a2e8-9d8bdb8656a6]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:23:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-feacbe99-5093-4054-9928-7eb070eca50c tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:17 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 Sep 01 12:23:17 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:18 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-feacbe99-5093-4054-9928-7eb070eca50c tempest-TestStampPattern-2092672715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41" returned: 0 in 0.344s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-feacbe99-5093-4054-9928-7eb070eca50c tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:18 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41 Sep 01 12:23:18 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:18 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-feacbe99-5093-4054-9928-7eb070eca50c tempest-TestStampPattern-2092672715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ac7f9b1f-5110-45e6-bd31-97824b836b41" returned: 0 in 0.229s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-feacbe99-5093-4054-9928-7eb070eca50c tempest-TestStampPattern-2092672715 None] Lock "cinder-quobyte-ac7f9b1f-5110-45e6-bd31-97824b836b41" released by "delete_volume" :: held 0.628s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:18 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-feacbe99-5093-4054-9928-7eb070eca50c tempest-TestStampPattern-2092672715 None] Created reservations ['361592fb-33b2-4ec6-a88a-160a1a32168d', '243efbd5-ac20-4254-b860-1a590f237483', '00e6d7de-6006-4127-bd9a-45fb21e82e21', '4a8f7e7f-f321-4370-b94f-20b4e1334118'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:23:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-feacbe99-5093-4054-9928-7eb070eca50c tempest-TestStampPattern-2092672715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-feacbe99-5093-4054-9928-7eb070eca50c tempest-TestStampPattern-2092672715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-feacbe99-5093-4054-9928-7eb070eca50c tempest-TestStampPattern-2092672715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-feacbe99-5093-4054-9928-7eb070eca50c tempest-TestStampPattern-2092672715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-feacbe99-5093-4054-9928-7eb070eca50c tempest-TestStampPattern-2092672715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-feacbe99-5093-4054-9928-7eb070eca50c tempest-TestStampPattern-2092672715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:18 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:23:18 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:18 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-feacbe99-5093-4054-9928-7eb070eca50c tempest-TestStampPattern-2092672715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.235s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:18 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-feacbe99-5093-4054-9928-7eb070eca50c tempest-TestStampPattern-2092672715 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:23:18 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-feacbe99-5093-4054-9928-7eb070eca50c tempest-TestStampPattern-2092672715 None] Deleted volume successfully. Sep 01 12:23:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-feacbe99-5093-4054-9928-7eb070eca50c tempest-TestStampPattern-2092672715 None] Lock "cinder-ac7f9b1f-5110-45e6-bd31-97824b836b41-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:28 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=17,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:23:28 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=29,cinder:INSERT=6,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Flow 'volume_create_manager' (eddd6e3c-fbf2-4035-8f07-14f3612cde05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396f810f-fe5c-4f78-a8b8-1628a27f8259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396f810f-fe5c-4f78-a8b8-1628a27f8259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-287588381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ce631deb704f8ea828a165b99510cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:39Z,use_quota=True,user_id='3c86440481cb42ea80c76388f548abf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e18631-548a-4423-acf4-962a4eea9c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e18631-548a-4423-acf4-962a4eea9c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ea3e26-e12f-4f5b-a02f-a2704b49bce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ea3e26-e12f-4f5b-a02f-a2704b49bce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19', 'volume_name': 'volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a302f09d-6a2c-4624-8eaf-1ed0228b855b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a302f09d-6a2c-4624-8eaf-1ed0228b855b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676231b0-5ec7-4c60-93a1-87b743cb7e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:38 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Volume a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19', 'volume_size': 1} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-287588381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ce631deb704f8ea828a165b99510cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:39Z,use_quota=True,user_id='3c86440481cb42ea80c76388f548abf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Creating volume a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:23:38 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:38 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 1073741824 Sep 01 12:23:38 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Flow 'volume_create_manager' (b0eaaa16-8bf0-4600-bc37-45db10c3b7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505c3888-7a1f-4e7c-bc25-1be2009278ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505c3888-7a1f-4e7c-bc25-1be2009278ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-491495358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e9394927c04d469161851250606e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:39Z,use_quota=True,user_id='e3da9dc9085c45a199fe919096b233fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf3f2fd-6c39-45ce-a0e0-751e077473da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf3f2fd-6c39-45ce-a0e0-751e077473da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cabab90-b3a4-4a25-8e3c-697d971a8f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cabab90-b3a4-4a25-8e3c-697d971a8f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d', 'volume_name': 'volume-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd3d7282-5115-4f4b-a295-131fc1c20d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd3d7282-5115-4f4b-a295-131fc1c20d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc5e3ef-7a8a-4bc0-99a5-fcbf3ea295a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:38 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Volume 8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d', 'volume_size': 1} Sep 01 12:23:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Flow 'volume_create_manager' (a3197c09-40c9-417e-a6d5-f67d5151174b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36afcf8f-3c58-4c60-a82f-417280051a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36afcf8f-3c58-4c60-a82f-417280051a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1573668789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51491d88-b38d-4a13-8c0e-792ad4a9a073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e9394927c04d469161851250606e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:39Z,use_quota=True,user_id='e3da9dc9085c45a199fe919096b233fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09dfb997-a4d6-4cfc-98a8-d8dc9d30b235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09dfb997-a4d6-4cfc-98a8-d8dc9d30b235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3713c7d-da16-480d-849a-883bdf2fa622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3713c7d-da16-480d-849a-883bdf2fa622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51491d88-b38d-4a13-8c0e-792ad4a9a073', 'volume_name': 'volume-51491d88-b38d-4a13-8c0e-792ad4a9a073', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baaef8e5-846e-48eb-8e5e-9885b78cf785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baaef8e5-846e-48eb-8e5e-9885b78cf785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0789840-5c79-4ec4-b3a1-b34e3f35fdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Volume 51491d88-b38d-4a13-8c0e-792ad4a9a073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51491d88-b38d-4a13-8c0e-792ad4a9a073', 'volume_size': 1} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:39 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 1073741824" returned: 0 in 0.657s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:39 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 Sep 01 12:23:39 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Flow 'volume_create_manager' (f10836fd-8be7-4b9c-9062-e3bf415de444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f64cac-346a-41b0-9c32-4797d49f6f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Flow 'volume_create_manager' (ad610380-56e5-476d-be03-4d39cfcc3be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a4ca5b-2f66-4d6a-afa9-4ff4a072be71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:39 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f64cac-346a-41b0-9c32-4797d49f6f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2135722388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad82a4e-c1e8-4252-abe6-78c6f8568efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca474317c549ceb96498052c2a5f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:40Z,use_quota=True,user_id='1cc70de268d54011a6269f1f6e6cd2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243e0a80-349d-4c43-964c-b55f6c11c6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243e0a80-349d-4c43-964c-b55f6c11c6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927235ba-2130-4c7d-bf2e-b290e83c1779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927235ba-2130-4c7d-bf2e-b290e83c1779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bad82a4e-c1e8-4252-abe6-78c6f8568efc', 'volume_name': 'volume-bad82a4e-c1e8-4252-abe6-78c6f8568efc', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a616dbf-da75-4c4b-b7b5-d59ceb2e11cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a616dbf-da75-4c4b-b7b5-d59ceb2e11cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c972812e-08be-46ed-9362-cd1675762c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Volume bad82a4e-c1e8-4252-abe6-78c6f8568efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bad82a4e-c1e8-4252-abe6-78c6f8568efc', 'volume_size': 1} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19" returned: 0 in 0.424s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a4ca5b-2f66-4d6a-afa9-4ff4a072be71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1857355626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0092f9be-1799-4ec9-9bf1-a7ab15f5a587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e9394927c04d469161851250606e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:40Z,use_quota=True,user_id='e3da9dc9085c45a199fe919096b233fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa33e704-8af3-41e8-8ee8-143d9f24fbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa33e704-8af3-41e8-8ee8-143d9f24fbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaff45bc-eb48-4a17-a9c4-3b131d672cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaff45bc-eb48-4a17-a9c4-3b131d672cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0092f9be-1799-4ec9-9bf1-a7ab15f5a587', 'volume_name': 'volume-0092f9be-1799-4ec9-9bf1-a7ab15f5a587', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aac33c9-f944-4c09-a679-75c359c4fd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aac33c9-f944-4c09-a679-75c359c4fd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c5a64e-6a21-43f5-bd6e-fad68d869e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:40 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Volume 0092f9be-1799-4ec9-9bf1-a7ab15f5a587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0092f9be-1799-4ec9-9bf1-a7ab15f5a587', 'volume_size': 1} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.026s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-491495358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e9394927c04d469161851250606e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:39Z,use_quota=True,user_id='e3da9dc9085c45a199fe919096b233fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Creating volume 8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:23:40 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676231b0-5ec7-4c60-93a1-87b743cb7e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1163ce9c-8fc2-4cc1-bbe5-57e7745842d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:40 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d 1073741824 Sep 01 12:23:40 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:40 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Volume volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 (a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19): created successfully Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1163ce9c-8fc2-4cc1-bbe5-57e7745842d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Flow 'volume_create_manager' (eddd6e3c-fbf2-4035-8f07-14f3612cde05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:40 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-799ac22c-e472-4e96-b5ba-bf7ff207ea3d tempest-VolumeDependencyTests-1858620102 None] Created volume successfully. Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Flow 'volume_create_manager' (1ecf7033-841c-41bb-bc07-3e5b8cd4cfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9cb1c9-cec9-4a4b-bc64-01701a74735d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9cb1c9-cec9-4a4b-bc64-01701a74735d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1312801731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51eac02a-961c-4225-941b-81c74e0a2c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e9394927c04d469161851250606e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:40Z,use_quota=True,user_id='e3da9dc9085c45a199fe919096b233fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96fd43d8-e5b3-4981-9c21-8b09f1d95b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96fd43d8-e5b3-4981-9c21-8b09f1d95b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51932aff-2549-433c-820b-dd244b3f3a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51932aff-2549-433c-820b-dd244b3f3a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51eac02a-961c-4225-941b-81c74e0a2c7d', 'volume_name': 'volume-51eac02a-961c-4225-941b-81c74e0a2c7d', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851b829d-406c-4b9a-98f4-95b6b4e6932f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851b829d-406c-4b9a-98f4-95b6b4e6932f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5d3c3c-448e-42e9-b153-e34a0a49091d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:40 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Volume 51eac02a-961c-4225-941b-81c74e0a2c7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51eac02a-961c-4225-941b-81c74e0a2c7d', 'volume_size': 1} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Flow 'volume_create_manager' (6d6d7abd-9cad-4991-b87c-0b30484f0d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9deee2-8ab8-40d2-bf27-f547595a6ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9deee2-8ab8-40d2-bf27-f547595a6ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-384208134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb240b36-7865-4f5d-9518-573d5cd5b2e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e9394927c04d469161851250606e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:40Z,use_quota=True,user_id='e3da9dc9085c45a199fe919096b233fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4b5099-1b2a-421c-b61b-1786841fb1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:40 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4b5099-1b2a-421c-b61b-1786841fb1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37203a4e-bdbd-4808-996c-1836e3598325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37203a4e-bdbd-4808-996c-1836e3598325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb240b36-7865-4f5d-9518-573d5cd5b2e2', 'volume_name': 'volume-cb240b36-7865-4f5d-9518-573d5cd5b2e2', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb44230-c9c3-48c5-a6d3-8b4295e48a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb44230-c9c3-48c5-a6d3-8b4295e48a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b01b54-1ac0-42df-869c-2be7c504f3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:40 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Volume cb240b36-7865-4f5d-9518-573d5cd5b2e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb240b36-7865-4f5d-9518-573d5cd5b2e2', 'volume_size': 1} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d 1073741824" returned: 0 in 0.602s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:40 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d Sep 01 12:23:40 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:40 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d" returned: 0 in 0.299s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.698s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1573668789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51491d88-b38d-4a13-8c0e-792ad4a9a073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e9394927c04d469161851250606e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:39Z,use_quota=True,user_id='e3da9dc9085c45a199fe919096b233fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Creating volume 51491d88-b38d-4a13-8c0e-792ad4a9a073 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:23:40 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:23:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51491d88-b38d-4a13-8c0e-792ad4a9a073 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:41 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51491d88-b38d-4a13-8c0e-792ad4a9a073 1073741824 Sep 01 12:23:41 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc5e3ef-7a8a-4bc0-99a5-fcbf3ea295a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa25859e-ad6d-4bb5-9f33-c54571bc2c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b38f0bb7-b7a5-4988-8636-267d39e34e9e tempest-VolumeDependencyTests-1858620102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Volume volume-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d (8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d): created successfully Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa25859e-ad6d-4bb5-9f33-c54571bc2c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Flow 'volume_create_manager' (b0eaaa16-8bf0-4600-bc37-45db10c3b7cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b88114bd-ec4e-496c-a97e-eb492ef25570 tempest-CreateVolumesFromImageTest-2087270422 None] Created volume successfully. Sep 01 12:23:41 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51491d88-b38d-4a13-8c0e-792ad4a9a073 1073741824" returned: 0 in 0.417s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51491d88-b38d-4a13-8c0e-792ad4a9a073 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:41 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51491d88-b38d-4a13-8c0e-792ad4a9a073 Sep 01 12:23:41 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:41 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51491d88-b38d-4a13-8c0e-792ad4a9a073" returned: 0 in 0.269s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.737s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2135722388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad82a4e-c1e8-4252-abe6-78c6f8568efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca474317c549ceb96498052c2a5f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:40Z,use_quota=True,user_id='1cc70de268d54011a6269f1f6e6cd2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Creating volume bad82a4e-c1e8-4252-abe6-78c6f8568efc {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:23:41 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bad82a4e-c1e8-4252-abe6-78c6f8568efc 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:41 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bad82a4e-c1e8-4252-abe6-78c6f8568efc 1073741824 Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0789840-5c79-4ec4-b3a1-b34e3f35fdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51491d88-b38d-4a13-8c0e-792ad4a9a073', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:41 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cab89e4-e795-48d3-b888-72c4da201deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:41 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Volume volume-51491d88-b38d-4a13-8c0e-792ad4a9a073 (51491d88-b38d-4a13-8c0e-792ad4a9a073): created successfully Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cab89e4-e795-48d3-b888-72c4da201deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Flow 'volume_create_manager' (a3197c09-40c9-417e-a6d5-f67d5151174b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3476d75a-5687-43f4-b5a0-85a8383d88fc tempest-CreateVolumesFromImageTest-2087270422 None] Created volume successfully. Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:41 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:23:41 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:42 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.276s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:23:42 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bad82a4e-c1e8-4252-abe6-78c6f8568efc 1073741824" returned: 0 in 0.466s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bad82a4e-c1e8-4252-abe6-78c6f8568efc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:42 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bad82a4e-c1e8-4252-abe6-78c6f8568efc Sep 01 12:23:42 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:42 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bad82a4e-c1e8-4252-abe6-78c6f8568efc" returned: 0 in 0.253s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.464s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1857355626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0092f9be-1799-4ec9-9bf1-a7ab15f5a587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e9394927c04d469161851250606e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:40Z,use_quota=True,user_id='e3da9dc9085c45a199fe919096b233fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Creating volume 0092f9be-1799-4ec9-9bf1-a7ab15f5a587 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:23:42 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0092f9be-1799-4ec9-9bf1-a7ab15f5a587 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c972812e-08be-46ed-9362-cd1675762c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bad82a4e-c1e8-4252-abe6-78c6f8568efc', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:42 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0092f9be-1799-4ec9-9bf1-a7ab15f5a587 1073741824 Sep 01 12:23:42 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19908bbb-4ff9-4bc6-bdcb-975005614a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:42 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Volume volume-bad82a4e-c1e8-4252-abe6-78c6f8568efc (bad82a4e-c1e8-4252-abe6-78c6f8568efc): created successfully Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19908bbb-4ff9-4bc6-bdcb-975005614a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Flow 'volume_create_manager' (f10836fd-8be7-4b9c-9062-e3bf415de444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:42 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3c5a37bf-d41a-4160-96b9-7bc702848daa tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Created volume successfully. Sep 01 12:23:43 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Flow 'volume_create_manager' (f18ee690-5532-4332-9487-db888a3d6ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (059ab065-1a45-492f-a654-fd67c5c5d7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0092f9be-1799-4ec9-9bf1-a7ab15f5a587 1073741824" returned: 0 in 0.645s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (059ab065-1a45-492f-a654-fd67c5c5d7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53268c7-3b60-4c2e-9492-93e2ea726b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6367e0138b479aacdd4c6524bad929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:43Z,use_quota=True,user_id='1d04616097684e64ae09f2418f182276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b29a6287-68a8-4944-bc50-ebcd2a52d75d),volume_type_id=b29a6287-68a8-4944-bc50-ebcd2a52d75d)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0451ff6d-cf37-4764-bf3f-d054f7e6f2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0451ff6d-cf37-4764-bf3f-d054f7e6f2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dab5195-0bf5-4ecf-a3b4-e64d3a8850af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.image.glance [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Creating Keystone auth plugin from conf {{(pid=87084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0092f9be-1799-4ec9-9bf1-a7ab15f5a587 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:43 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0092f9be-1799-4ec9-9bf1-a7ab15f5a587 Sep 01 12:23:43 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Flow 'volume_create_manager' (0d41c908-f9f3-4e7d-ab25-8552d00d9650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd54e87c-97ad-42ba-a817-199dc9565d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd54e87c-97ad-42ba-a817-199dc9565d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2131231384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca474317c549ceb96498052c2a5f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:43Z,use_quota=True,user_id='1cc70de268d54011a6269f1f6e6cd2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8cb01d6-31f3-4961-96da-46c6a9b6c851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8cb01d6-31f3-4961-96da-46c6a9b6c851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a45b7a50-3823-4b77-98c0-cd4789d619e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a45b7a50-3823-4b77-98c0-cd4789d619e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7', 'volume_name': 'volume-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:43 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a39c66c7-e2cf-4dfc-ada8-1a2657c3106f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a39c66c7-e2cf-4dfc-ada8-1a2657c3106f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f567f4f2-5163-4549-9d31-28a1ef8f8f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:43 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Volume e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7', 'volume_size': 1} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0092f9be-1799-4ec9-9bf1-a7ab15f5a587" returned: 0 in 0.342s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.273s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1312801731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51eac02a-961c-4225-941b-81c74e0a2c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e9394927c04d469161851250606e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:40Z,use_quota=True,user_id='e3da9dc9085c45a199fe919096b233fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Creating volume 51eac02a-961c-4225-941b-81c74e0a2c7d {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:23:43 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51eac02a-961c-4225-941b-81c74e0a2c7d 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:43 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51eac02a-961c-4225-941b-81c74e0a2c7d 1073741824 Sep 01 12:23:43 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c5a64e-6a21-43f5-bd6e-fad68d869e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0092f9be-1799-4ec9-9bf1-a7ab15f5a587', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b3d4378-ad61-4dc1-b0d7-aaf079238082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dab5195-0bf5-4ecf-a3b4-e64d3a8850af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e53268c7-3b60-4c2e-9492-93e2ea726b8e', 'volume_name': 'volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e', 'volume_size': 1, 'image_id': '25762d67-40a5-4f0d-9545-7829c2066422', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25762d67-40a5-4f0d-9545-7829c2066422', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aca6cf0697b22dce584fdec52a670911', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7e6367e0138b479aacdd4c6524bad929', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '02d701cc31a81fbd37240233a442ed598625ae02a134c28e4ad5ecd50c17be315e41cb1d718117fbfe35a3d214741f64b6461102ceb36064bafef57da9693d0a', 'id': '25762d67-40a5-4f0d-9545-7829c2066422', 'created_at': datetime.datetime(2026, 9, 1, 10, 23, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25762d67-40a5-4f0d-9545-7829c2066422/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9fe602-7f2f-4afb-a198-14807d90c413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9fe602-7f2f-4afb-a198-14807d90c413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce1d79a-5ccc-4232-9c9a-74a74ca1d27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:43 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Volume e53268c7-3b60-4c2e-9492-93e2ea726b8e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e', 'volume_size': 1, 'image_id': '25762d67-40a5-4f0d-9545-7829c2066422', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25762d67-40a5-4f0d-9545-7829c2066422', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aca6cf0697b22dce584fdec52a670911', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7e6367e0138b479aacdd4c6524bad929', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '02d701cc31a81fbd37240233a442ed598625ae02a134c28e4ad5ecd50c17be315e41cb1d718117fbfe35a3d214741f64b6461102ceb36064bafef57da9693d0a', 'id': '25762d67-40a5-4f0d-9545-7829c2066422', 'created_at': datetime.datetime(2026, 9, 1, 10, 23, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25762d67-40a5-4f0d-9545-7829c2066422/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Trying to clone e53268c7-3b60-4c2e-9492-93e2ea726b8e from image 25762d67-40a5-4f0d-9545-7829c2066422 at location (None, [{'url': 'file:///opt/stack/data/glance/images/25762d67-40a5-4f0d-9545-7829c2066422', 'metadata': {}}]). {{(pid=87084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 12:23:43 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Volume volume-0092f9be-1799-4ec9-9bf1-a7ab15f5a587 (0092f9be-1799-4ec9-9bf1-a7ab15f5a587): created successfully Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b3d4378-ad61-4dc1-b0d7-aaf079238082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Flow 'volume_create_manager' (ad610380-56e5-476d-be03-4d39cfcc3be6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-148f277a-4da8-4223-a077-ab833caf1e79 tempest-CreateVolumesFromImageTest-2087270422 None] Created volume successfully. Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 12:23:43 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Image download 0.00 MB at 0.00 MB/s Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7291fb0f-7b22-4a33-b21c-b6b833f15bee]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:43 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Flow 'volume_create_manager' (7133e2b4-b09e-47b9-9f25-f22cb4d06380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d697d0-e02a-4cd2-8665-f93bd16790ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d697d0-e02a-4cd2-8665-f93bd16790ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-647626206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b5ebfb-3245-437f-a156-b7dd81b3e65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca474317c549ceb96498052c2a5f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:44Z,use_quota=True,user_id='1cc70de268d54011a6269f1f6e6cd2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4834c042-bc8d-4365-be8e-9d54066ec634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4834c042-bc8d-4365-be8e-9d54066ec634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5af3127-d551-4f98-8f26-5ae6faded164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5af3127-d551-4f98-8f26-5ae6faded164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24b5ebfb-3245-437f-a156-b7dd81b3e65b', 'volume_name': 'volume-24b5ebfb-3245-437f-a156-b7dd81b3e65b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e56a40-7778-41c0-a997-52a6c79c8239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e56a40-7778-41c0-a997-52a6c79c8239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c41da3f-c2e4-4d01-a190-06cdc0d74f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:44 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Volume 24b5ebfb-3245-437f-a156-b7dd81b3e65b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24b5ebfb-3245-437f-a156-b7dd81b3e65b', 'volume_size': 1} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:44 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD Sep 01 12:23:44 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:44 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51eac02a-961c-4225-941b-81c74e0a2c7d 1073741824" returned: 0 in 0.671s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51eac02a-961c-4225-941b-81c74e0a2c7d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:44 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51eac02a-961c-4225-941b-81c74e0a2c7d Sep 01 12:23:44 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:44 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Flow 'volume_create_manager' (68eceac4-3ed4-450a-9884-28fbcd24c440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beaddda9-6d61-4fd2-a749-077a8f715e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD" returned: 0 in 0.449s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beaddda9-6d61-4fd2-a749-077a8f715e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1586423238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73689d8-a42a-4670-9178-3558dd917552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca474317c549ceb96498052c2a5f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:44Z,use_quota=True,user_id='1cc70de268d54011a6269f1f6e6cd2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45f5f06-46ec-498e-98e0-e59b467e2d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45f5f06-46ec-498e-98e0-e59b467e2d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ddaebd-e22d-41f4-b805-8c1bc6b6a9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ddaebd-e22d-41f4-b805-8c1bc6b6a9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c73689d8-a42a-4670-9178-3558dd917552', 'volume_name': 'volume-c73689d8-a42a-4670-9178-3558dd917552', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d4096b-187c-4817-a651-ccbdc5d5cca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d4096b-187c-4817-a651-ccbdc5d5cca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73fd38d1-1242-42bd-abeb-3c12ae784bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:44 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Volume c73689d8-a42a-4670-9178-3558dd917552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c73689d8-a42a-4670-9178-3558dd917552', 'volume_size': 1} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:44 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD Sep 01 12:23:44 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:44 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51eac02a-961c-4225-941b-81c74e0a2c7d" returned: 0 in 0.295s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.939s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-384208134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb240b36-7865-4f5d-9518-573d5cd5b2e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e9394927c04d469161851250606e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:40Z,use_quota=True,user_id='e3da9dc9085c45a199fe919096b233fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Creating volume cb240b36-7865-4f5d-9518-573d5cd5b2e2 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:23:44 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cb240b36-7865-4f5d-9518-573d5cd5b2e2 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5d3c3c-448e-42e9-b153-e34a0a49091d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51eac02a-961c-4225-941b-81c74e0a2c7d', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:44 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cb240b36-7865-4f5d-9518-573d5cd5b2e2 1073741824 Sep 01 12:23:44 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7544ae2-0da2-4039-b54d-ad7feedef029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:44 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Volume volume-51eac02a-961c-4225-941b-81c74e0a2c7d (51eac02a-961c-4225-941b-81c74e0a2c7d): created successfully Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7544ae2-0da2-4039-b54d-ad7feedef029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Flow 'volume_create_manager' (1ecf7033-841c-41bb-bc07-3e5b8cd4cfc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:44 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-de353db7-fc58-45f1-a706-285130f55ab9 tempest-CreateVolumesFromImageTest-2087270422 None] Created volume successfully. Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Flow 'volume_create_manager' (2183db32-85d3-4e8d-8b62-8508805b6d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:44 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8667760a-4563-4e91-b97d-82c1382b9593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD" returned: 1 in 0.415s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Temporary image 25762d67-40a5-4f0d-9545-7829c2066422 is fetched for user 1d04616097684e64ae09f2418f182276. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8667760a-4563-4e91-b97d-82c1382b9593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2117821007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe26fc6-5402-4197-a914-6c2243773d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca474317c549ceb96498052c2a5f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:45Z,use_quota=True,user_id='1cc70de268d54011a6269f1f6e6cd2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631ffa21-bebe-426c-a095-5f587e7990df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631ffa21-bebe-426c-a095-5f587e7990df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a0fe06-6ecf-4fa7-8903-1f55dd04e98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a0fe06-6ecf-4fa7-8903-1f55dd04e98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffe26fc6-5402-4197-a914-6c2243773d5f', 'volume_name': 'volume-ffe26fc6-5402-4197-a914-6c2243773d5f', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15794293-49cb-4525-9483-befa6051e247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15794293-49cb-4525-9483-befa6051e247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c37e2b-ceb8-404e-a186-ea95e51925fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:44 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Volume ffe26fc6-5402-4197-a914-6c2243773d5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffe26fc6-5402-4197-a914-6c2243773d5f', 'volume_size': 1} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4316b0-aa1f-41cf-87d3-0a876b237b5f]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:23:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:45 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD Sep 01 12:23:45 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:23:45 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Flow 'volume_create_manager' (fc531370-fc1a-44f6-9f65-d71722941e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496e6b1c-9484-49bd-b0da-bfdb75a6a3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cb240b36-7865-4f5d-9518-573d5cd5b2e2 1073741824" returned: 0 in 0.670s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496e6b1c-9484-49bd-b0da-bfdb75a6a3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-79331077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e00677-3984-4ca3-8ba7-f2b5153280a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca474317c549ceb96498052c2a5f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:45Z,use_quota=True,user_id='1cc70de268d54011a6269f1f6e6cd2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dce3943-5246-4a78-9daa-b0cc08bb3f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dce3943-5246-4a78-9daa-b0cc08bb3f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485a9238-f62b-45a3-bb18-1e875b736c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485a9238-f62b-45a3-bb18-1e875b736c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74e00677-3984-4ca3-8ba7-f2b5153280a8', 'volume_name': 'volume-74e00677-3984-4ca3-8ba7-f2b5153280a8', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50340442-6a89-4f52-9223-41426ceaa767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50340442-6a89-4f52-9223-41426ceaa767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:45 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd3b7a93-a9a1-4eec-8711-b5066fb74124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:45 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Volume 74e00677-3984-4ca3-8ba7-f2b5153280a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74e00677-3984-4ca3-8ba7-f2b5153280a8', 'volume_size': 1} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cb240b36-7865-4f5d-9518-573d5cd5b2e2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:45 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cb240b36-7865-4f5d-9518-573d5cd5b2e2 Sep 01 12:23:45 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:45 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD Sep 01 12:23:45 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:45 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cb240b36-7865-4f5d-9518-573d5cd5b2e2" returned: 0 in 0.245s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b38f0bb7-b7a5-4988-8636-267d39e34e9e tempest-VolumeDependencyTests-1858620102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.564s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-b38f0bb7-b7a5-4988-8636-267d39e34e9e tempest-VolumeDependencyTests-1858620102 None] Creating offline snapshot caf2c975-8534-484b-9cc0-d96a5f070702 of volume a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b01b54-1ac0-42df-869c-2be7c504f3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb240b36-7865-4f5d-9518-573d5cd5b2e2', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371e6bad-6f11-46e5-ada9-e75c8f51532e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:45 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae56fc2-8ab3-4d54-94e2-0d0fe4d0d8e0]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b38f0bb7-b7a5-4988-8636-267d39e34e9e tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD" returned: 1 in 0.337s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:45 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Volume volume-cb240b36-7865-4f5d-9518-573d5cd5b2e2 (cb240b36-7865-4f5d-9518-573d5cd5b2e2): created successfully Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371e6bad-6f11-46e5-ada9-e75c8f51532e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Flow 'volume_create_manager' (6d6d7abd-9cad-4991-b87c-0b30484f0d4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-78140bd3-dc4c-4593-86af-05fdb517a3e2 tempest-CreateVolumesFromImageTest-2087270422 None] Created volume successfully. Sep 01 12:23:45 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 Sep 01 12:23:45 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:46 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b38f0bb7-b7a5-4988-8636-267d39e34e9e tempest-VolumeDependencyTests-1858620102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19" returned: 0 in 0.376s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b38f0bb7-b7a5-4988-8636-267d39e34e9e tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:46 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702 1G Sep 01 12:23:46 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-63102f11-1268-4047-9469-3f95077eabac tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "cinder-cb240b36-7865-4f5d-9518-573d5cd5b2e2-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-63102f11-1268-4047-9469-3f95077eabac tempest-CreateVolumesFromImageTest-2087270422 None] Lock "cinder-cb240b36-7865-4f5d-9518-573d5cd5b2e2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-63102f11-1268-4047-9469-3f95077eabac tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "cinder-quobyte-cb240b36-7865-4f5d-9518-573d5cd5b2e2" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-63102f11-1268-4047-9469-3f95077eabac tempest-CreateVolumesFromImageTest-2087270422 None] Lock "cinder-quobyte-cb240b36-7865-4f5d-9518-573d5cd5b2e2" acquired by "delete_volume" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:46 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aad4fb-a9e0-4823-8074-577d263391ca]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:23:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-63102f11-1268-4047-9469-3f95077eabac tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cb240b36-7865-4f5d-9518-573d5cd5b2e2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:46 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b38f0bb7-b7a5-4988-8636-267d39e34e9e tempest-VolumeDependencyTests-1858620102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702 1G" returned: 0 in 0.449s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b38f0bb7-b7a5-4988-8636-267d39e34e9e tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:46 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702 Sep 01 12:23:46 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:46 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cb240b36-7865-4f5d-9518-573d5cd5b2e2 Sep 01 12:23:46 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:46 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b38f0bb7-b7a5-4988-8636-267d39e34e9e tempest-VolumeDependencyTests-1858620102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702" returned: 0 in 0.297s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:46 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-b38f0bb7-b7a5-4988-8636-267d39e34e9e tempest-VolumeDependencyTests-1858620102 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702 is being set with open permissions: ugo+rw Sep 01 12:23:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b38f0bb7-b7a5-4988-8636-267d39e34e9e tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:46 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702 Sep 01 12:23:46 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:46 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-63102f11-1268-4047-9469-3f95077eabac tempest-CreateVolumesFromImageTest-2087270422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cb240b36-7865-4f5d-9518-573d5cd5b2e2" returned: 0 in 0.368s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-63102f11-1268-4047-9469-3f95077eabac tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cb240b36-7865-4f5d-9518-573d5cd5b2e2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:46 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cb240b36-7865-4f5d-9518-573d5cd5b2e2 Sep 01 12:23:46 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:47 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b38f0bb7-b7a5-4988-8636-267d39e34e9e tempest-VolumeDependencyTests-1858620102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702" returned: 0 in 0.247s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b38f0bb7-b7a5-4988-8636-267d39e34e9e tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:47 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-63102f11-1268-4047-9469-3f95077eabac tempest-CreateVolumesFromImageTest-2087270422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cb240b36-7865-4f5d-9518-573d5cd5b2e2" returned: 0 in 0.255s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-63102f11-1268-4047-9469-3f95077eabac tempest-CreateVolumesFromImageTest-2087270422 None] Lock "cinder-quobyte-cb240b36-7865-4f5d-9518-573d5cd5b2e2" released by "delete_volume" :: held 0.664s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:47 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.info Sep 01 12:23:47 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-63102f11-1268-4047-9469-3f95077eabac tempest-CreateVolumesFromImageTest-2087270422 None] Created reservations ['829bec43-4f4e-46e1-b702-4ffb98de4ed8', '76650cb4-81b5-42a2-b72e-1343f9b7907f', 'fadc4e2e-026c-45d4-8abc-93e07aaa7987', '9abc55d9-29b2-4714-bae1-a1f12ffe95db'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-63102f11-1268-4047-9469-3f95077eabac tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-63102f11-1268-4047-9469-3f95077eabac tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-63102f11-1268-4047-9469-3f95077eabac tempest-CreateVolumesFromImageTest-2087270422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-63102f11-1268-4047-9469-3f95077eabac tempest-CreateVolumesFromImageTest-2087270422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-63102f11-1268-4047-9469-3f95077eabac tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-63102f11-1268-4047-9469-3f95077eabac tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:47 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:23:47 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:47 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b38f0bb7-b7a5-4988-8636-267d39e34e9e tempest-VolumeDependencyTests-1858620102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.info" returned: 0 in 0.267s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:47 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-b38f0bb7-b7a5-4988-8636-267d39e34e9e tempest-VolumeDependencyTests-1858620102 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.info is being set with open permissions: ugo+rw Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b38f0bb7-b7a5-4988-8636-267d39e34e9e tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:47 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.info Sep 01 12:23:47 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:47 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-63102f11-1268-4047-9469-3f95077eabac tempest-CreateVolumesFromImageTest-2087270422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.273s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-63102f11-1268-4047-9469-3f95077eabac tempest-CreateVolumesFromImageTest-2087270422 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:23:47 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-63102f11-1268-4047-9469-3f95077eabac tempest-CreateVolumesFromImageTest-2087270422 None] Deleted volume successfully. Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-21977727-57f4-4a30-ac85-381aec20e6d1 tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "cinder-51eac02a-961c-4225-941b-81c74e0a2c7d-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-63102f11-1268-4047-9469-3f95077eabac tempest-CreateVolumesFromImageTest-2087270422 None] Lock "cinder-cb240b36-7865-4f5d-9518-573d5cd5b2e2-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-21977727-57f4-4a30-ac85-381aec20e6d1 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "cinder-51eac02a-961c-4225-941b-81c74e0a2c7d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-21977727-57f4-4a30-ac85-381aec20e6d1 tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "cinder-quobyte-51eac02a-961c-4225-941b-81c74e0a2c7d" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:47 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b38f0bb7-b7a5-4988-8636-267d39e34e9e tempest-VolumeDependencyTests-1858620102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.info" returned: 0 in 0.266s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b38f0bb7-b7a5-4988-8636-267d39e34e9e tempest-VolumeDependencyTests-1858620102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-21977727-57f4-4a30-ac85-381aec20e6d1 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "cinder-quobyte-51eac02a-961c-4225-941b-81c74e0a2c7d" acquired by "delete_volume" :: waited 0.031s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.069s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2131231384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca474317c549ceb96498052c2a5f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:43Z,use_quota=True,user_id='1cc70de268d54011a6269f1f6e6cd2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Creating volume e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:23:47 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7790d4-4ed1-49bb-a531-423e3a38b642]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:23:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-21977727-57f4-4a30-ac85-381aec20e6d1 tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51eac02a-961c-4225-941b-81c74e0a2c7d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:47 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7 1073741824 Sep 01 12:23:47 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:47 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b38f0bb7-b7a5-4988-8636-267d39e34e9e tempest-VolumeDependencyTests-1858620102 None] Create snapshot completed successfully Sep 01 12:23:47 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51eac02a-961c-4225-941b-81c74e0a2c7d Sep 01 12:23:47 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:48 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-21977727-57f4-4a30-ac85-381aec20e6d1 tempest-CreateVolumesFromImageTest-2087270422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51eac02a-961c-4225-941b-81c74e0a2c7d" returned: 0 in 0.372s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-21977727-57f4-4a30-ac85-381aec20e6d1 tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51eac02a-961c-4225-941b-81c74e0a2c7d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:48 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7 1073741824" returned: 0 in 0.405s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:48 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51eac02a-961c-4225-941b-81c74e0a2c7d Sep 01 12:23:48 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:48 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7 Sep 01 12:23:48 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:48 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-21977727-57f4-4a30-ac85-381aec20e6d1 tempest-CreateVolumesFromImageTest-2087270422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51eac02a-961c-4225-941b-81c74e0a2c7d" returned: 0 in 0.252s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-21977727-57f4-4a30-ac85-381aec20e6d1 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "cinder-quobyte-51eac02a-961c-4225-941b-81c74e0a2c7d" released by "delete_volume" :: held 0.674s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:48 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7" returned: 0 in 0.259s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.218s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-647626206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b5ebfb-3245-437f-a156-b7dd81b3e65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca474317c549ceb96498052c2a5f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:44Z,use_quota=True,user_id='1cc70de268d54011a6269f1f6e6cd2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Creating volume 24b5ebfb-3245-437f-a156-b7dd81b3e65b {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:23:48 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-24b5ebfb-3245-437f-a156-b7dd81b3e65b 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-21977727-57f4-4a30-ac85-381aec20e6d1 tempest-CreateVolumesFromImageTest-2087270422 None] Created reservations ['55ca8a0d-c084-492a-8a74-52c7638ef593', '05bc4b35-cecf-419f-88a9-f4e9b6eabfe9', 'da1c0722-6a84-42f8-a403-5101ac4baf4f', 'c0c2b202-f696-4d87-82e0-e3c68adfbd50'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f567f4f2-5163-4549-9d31-28a1ef8f8f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d921e0-13a3-4bce-8cf2-4b3ffba8173c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:48 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-24b5ebfb-3245-437f-a156-b7dd81b3e65b 1073741824 Sep 01 12:23:48 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:48 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Volume volume-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7 (e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7): created successfully Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d921e0-13a3-4bce-8cf2-4b3ffba8173c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Flow 'volume_create_manager' (0d41c908-f9f3-4e7d-ab25-8552d00d9650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e464a6d1-1c46-4cbd-be8c-ec346fb2ca3d tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Created volume successfully. Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-21977727-57f4-4a30-ac85-381aec20e6d1 tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-21977727-57f4-4a30-ac85-381aec20e6d1 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-21977727-57f4-4a30-ac85-381aec20e6d1 tempest-CreateVolumesFromImageTest-2087270422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-21977727-57f4-4a30-ac85-381aec20e6d1 tempest-CreateVolumesFromImageTest-2087270422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-21977727-57f4-4a30-ac85-381aec20e6d1 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-21977727-57f4-4a30-ac85-381aec20e6d1 tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:48 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:23:48 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d13690c9-2505-4388-99c8-3844df58e361 tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "cinder-0092f9be-1799-4ec9-9bf1-a7ab15f5a587-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d13690c9-2505-4388-99c8-3844df58e361 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "cinder-0092f9be-1799-4ec9-9bf1-a7ab15f5a587-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:48 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-21977727-57f4-4a30-ac85-381aec20e6d1 tempest-CreateVolumesFromImageTest-2087270422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.323s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-21977727-57f4-4a30-ac85-381aec20e6d1 tempest-CreateVolumesFromImageTest-2087270422 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:23:48 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-21977727-57f4-4a30-ac85-381aec20e6d1 tempest-CreateVolumesFromImageTest-2087270422 None] Deleted volume successfully. Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d13690c9-2505-4388-99c8-3844df58e361 tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "cinder-quobyte-0092f9be-1799-4ec9-9bf1-a7ab15f5a587" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-21977727-57f4-4a30-ac85-381aec20e6d1 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "cinder-51eac02a-961c-4225-941b-81c74e0a2c7d-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d13690c9-2505-4388-99c8-3844df58e361 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "cinder-quobyte-0092f9be-1799-4ec9-9bf1-a7ab15f5a587" acquired by "delete_volume" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[537a17f0-5611-4c22-be98-47216fd79496]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d13690c9-2505-4388-99c8-3844df58e361 tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0092f9be-1799-4ec9-9bf1-a7ab15f5a587 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:48 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-24b5ebfb-3245-437f-a156-b7dd81b3e65b 1073741824" returned: 0 in 0.598s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-24b5ebfb-3245-437f-a156-b7dd81b3e65b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:49 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-24b5ebfb-3245-437f-a156-b7dd81b3e65b Sep 01 12:23:49 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:23:49 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0092f9be-1799-4ec9-9bf1-a7ab15f5a587 Sep 01 12:23:49 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Flow 'volume_create_manager' (e68d455d-c404-4c69-b3d9-8d0a5c815d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c30211b-f5a2-44a1-9a52-1c9160c5b754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c30211b-f5a2-44a1-9a52-1c9160c5b754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-108732853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75aacda-8bf4-409a-b551-e780db93d2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ce631deb704f8ea828a165b99510cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=caf2c975-8534-484b-9cc0-d96a5f070702,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:49Z,use_quota=True,user_id='3c86440481cb42ea80c76388f548abf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e173685-72ca-46cc-8f12-30f490e8ad4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e173685-72ca-46cc-8f12-30f490e8ad4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6df42d-175f-429c-90ea-8478c96e401e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6df42d-175f-429c-90ea-8478c96e401e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e75aacda-8bf4-409a-b551-e780db93d2a2', 'volume_name': 'volume-e75aacda-8bf4-409a-b551-e780db93d2a2', 'volume_size': 1, 'snapshot_id': 'caf2c975-8534-484b-9cc0-d96a5f070702'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a44d8f-9f49-4445-95a7-851d44599748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a44d8f-9f49-4445-95a7-851d44599748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98121d1-cf15-4e75-b310-2ff719598355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:49 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Volume e75aacda-8bf4-409a-b551-e780db93d2a2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e75aacda-8bf4-409a-b551-e780db93d2a2', 'volume_size': 1, 'snapshot_id': 'caf2c975-8534-484b-9cc0-d96a5f070702'} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:49 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-24b5ebfb-3245-437f-a156-b7dd81b3e65b" returned: 0 in 0.264s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.771s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1586423238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73689d8-a42a-4670-9178-3558dd917552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca474317c549ceb96498052c2a5f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:44Z,use_quota=True,user_id='1cc70de268d54011a6269f1f6e6cd2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Creating volume c73689d8-a42a-4670-9178-3558dd917552 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:23:49 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c73689d8-a42a-4670-9178-3558dd917552 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c41da3f-c2e4-4d01-a190-06cdc0d74f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24b5ebfb-3245-437f-a156-b7dd81b3e65b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:49 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c73689d8-a42a-4670-9178-3558dd917552 1073741824 Sep 01 12:23:49 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95323a9f-0300-4ffc-a958-0033a165a2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:49 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Volume volume-24b5ebfb-3245-437f-a156-b7dd81b3e65b (24b5ebfb-3245-437f-a156-b7dd81b3e65b): created successfully Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95323a9f-0300-4ffc-a958-0033a165a2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Flow 'volume_create_manager' (7133e2b4-b09e-47b9-9f25-f22cb4d06380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:49 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-eca46a9d-6632-465e-a460-e99954170d68 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Created volume successfully. Sep 01 12:23:49 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d13690c9-2505-4388-99c8-3844df58e361 tempest-CreateVolumesFromImageTest-2087270422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0092f9be-1799-4ec9-9bf1-a7ab15f5a587" returned: 0 in 0.449s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d13690c9-2505-4388-99c8-3844df58e361 tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0092f9be-1799-4ec9-9bf1-a7ab15f5a587 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:49 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0092f9be-1799-4ec9-9bf1-a7ab15f5a587 Sep 01 12:23:49 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:49 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d13690c9-2505-4388-99c8-3844df58e361 tempest-CreateVolumesFromImageTest-2087270422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0092f9be-1799-4ec9-9bf1-a7ab15f5a587" returned: 0 in 0.270s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d13690c9-2505-4388-99c8-3844df58e361 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "cinder-quobyte-0092f9be-1799-4ec9-9bf1-a7ab15f5a587" released by "delete_volume" :: held 0.773s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:49 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c73689d8-a42a-4670-9178-3558dd917552 1073741824" returned: 0 in 0.441s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-d13690c9-2505-4388-99c8-3844df58e361 tempest-CreateVolumesFromImageTest-2087270422 None] Created reservations ['c40b4c9e-b079-446f-88fc-e77fb517db60', 'be4cb364-3819-40e9-85d3-0ce4338ad537', '6da48a4a-0eca-4c8f-9dbd-c07fcc368828', 'c41c427e-fef5-4c12-9283-d1c0858800b6'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c73689d8-a42a-4670-9178-3558dd917552 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:49 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c73689d8-a42a-4670-9178-3558dd917552 Sep 01 12:23:49 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d13690c9-2505-4388-99c8-3844df58e361 tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d13690c9-2505-4388-99c8-3844df58e361 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d13690c9-2505-4388-99c8-3844df58e361 tempest-CreateVolumesFromImageTest-2087270422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d13690c9-2505-4388-99c8-3844df58e361 tempest-CreateVolumesFromImageTest-2087270422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d13690c9-2505-4388-99c8-3844df58e361 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d13690c9-2505-4388-99c8-3844df58e361 tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:49 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:23:49 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2ed27c2b-dfdf-404a-ac66-7e27cbfc875b tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "cinder-51491d88-b38d-4a13-8c0e-792ad4a9a073-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:50 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c73689d8-a42a-4670-9178-3558dd917552" returned: 0 in 0.275s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2ed27c2b-dfdf-404a-ac66-7e27cbfc875b tempest-CreateVolumesFromImageTest-2087270422 None] Lock "cinder-51491d88-b38d-4a13-8c0e-792ad4a9a073-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.146s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2117821007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe26fc6-5402-4197-a914-6c2243773d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca474317c549ceb96498052c2a5f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:45Z,use_quota=True,user_id='1cc70de268d54011a6269f1f6e6cd2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Creating volume ffe26fc6-5402-4197-a914-6c2243773d5f {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:23:50 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ffe26fc6-5402-4197-a914-6c2243773d5f 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:50 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ffe26fc6-5402-4197-a914-6c2243773d5f 1073741824 Sep 01 12:23:50 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73fd38d1-1242-42bd-abeb-3c12ae784bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c73689d8-a42a-4670-9178-3558dd917552', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa90f59-50e4-4131-b749-de0c5442646b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:50 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Volume volume-c73689d8-a42a-4670-9178-3558dd917552 (c73689d8-a42a-4670-9178-3558dd917552): created successfully Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa90f59-50e4-4131-b749-de0c5442646b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:50 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Flow 'volume_create_manager' (68eceac4-3ed4-450a-9884-28fbcd24c440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d13690c9-2505-4388-99c8-3844df58e361 tempest-CreateVolumesFromImageTest-2087270422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.313s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-d13690c9-2505-4388-99c8-3844df58e361 tempest-CreateVolumesFromImageTest-2087270422 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:23:50 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d13690c9-2505-4388-99c8-3844df58e361 tempest-CreateVolumesFromImageTest-2087270422 None] Deleted volume successfully. Sep 01 12:23:50 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d151183d-adfd-4050-b359-a63077c943c0 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Created volume successfully. Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2ed27c2b-dfdf-404a-ac66-7e27cbfc875b tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "cinder-quobyte-51491d88-b38d-4a13-8c0e-792ad4a9a073" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-d13690c9-2505-4388-99c8-3844df58e361 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "cinder-0092f9be-1799-4ec9-9bf1-a7ab15f5a587-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2ed27c2b-dfdf-404a-ac66-7e27cbfc875b tempest-CreateVolumesFromImageTest-2087270422 None] Lock "cinder-quobyte-51491d88-b38d-4a13-8c0e-792ad4a9a073" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[090e1690-8dd1-462d-a294-9fcde6db7a8e]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ed27c2b-dfdf-404a-ac66-7e27cbfc875b tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51491d88-b38d-4a13-8c0e-792ad4a9a073 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:50 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51491d88-b38d-4a13-8c0e-792ad4a9a073 Sep 01 12:23:50 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:50 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ffe26fc6-5402-4197-a914-6c2243773d5f 1073741824" returned: 0 in 0.412s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ffe26fc6-5402-4197-a914-6c2243773d5f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:50 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ffe26fc6-5402-4197-a914-6c2243773d5f Sep 01 12:23:50 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:50 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ed27c2b-dfdf-404a-ac66-7e27cbfc875b tempest-CreateVolumesFromImageTest-2087270422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51491d88-b38d-4a13-8c0e-792ad4a9a073" returned: 0 in 0.412s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ed27c2b-dfdf-404a-ac66-7e27cbfc875b tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51491d88-b38d-4a13-8c0e-792ad4a9a073 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:50 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51491d88-b38d-4a13-8c0e-792ad4a9a073 Sep 01 12:23:50 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:50 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ffe26fc6-5402-4197-a914-6c2243773d5f" returned: 0 in 0.268s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.443s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-79331077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e00677-3984-4ca3-8ba7-f2b5153280a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca474317c549ceb96498052c2a5f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:45Z,use_quota=True,user_id='1cc70de268d54011a6269f1f6e6cd2ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Creating volume 74e00677-3984-4ca3-8ba7-f2b5153280a8 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:23:50 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-74e00677-3984-4ca3-8ba7-f2b5153280a8 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:50 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-74e00677-3984-4ca3-8ba7-f2b5153280a8 1073741824 Sep 01 12:23:50 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c37e2b-ceb8-404e-a186-ea95e51925fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffe26fc6-5402-4197-a914-6c2243773d5f', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39c187c-9cac-48c1-bef1-47c981bcd6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:50 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Volume volume-ffe26fc6-5402-4197-a914-6c2243773d5f (ffe26fc6-5402-4197-a914-6c2243773d5f): created successfully Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39c187c-9cac-48c1-bef1-47c981bcd6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Flow 'volume_create_manager' (2183db32-85d3-4e8d-8b62-8508805b6d0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:50 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-361104d9-5ab9-43f3-ae10-2c5d69e9b8fb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Created volume successfully. Sep 01 12:23:50 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ed27c2b-dfdf-404a-ac66-7e27cbfc875b tempest-CreateVolumesFromImageTest-2087270422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-51491d88-b38d-4a13-8c0e-792ad4a9a073" returned: 0 in 0.265s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2ed27c2b-dfdf-404a-ac66-7e27cbfc875b tempest-CreateVolumesFromImageTest-2087270422 None] Lock "cinder-quobyte-51491d88-b38d-4a13-8c0e-792ad4a9a073" released by "delete_volume" :: held 0.715s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-2ed27c2b-dfdf-404a-ac66-7e27cbfc875b tempest-CreateVolumesFromImageTest-2087270422 None] Created reservations ['b1133ebf-e39d-49a7-a6c6-cb8074456e05', '5ff1e1f1-50a3-4da7-815f-0f044c7afa68', 'db07dedd-70ff-4beb-bb2e-1b267435149c', '865497c4-c956-4ea9-979a-a25b55d86084'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2ed27c2b-dfdf-404a-ac66-7e27cbfc875b tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2ed27c2b-dfdf-404a-ac66-7e27cbfc875b tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2ed27c2b-dfdf-404a-ac66-7e27cbfc875b tempest-CreateVolumesFromImageTest-2087270422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2ed27c2b-dfdf-404a-ac66-7e27cbfc875b tempest-CreateVolumesFromImageTest-2087270422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2ed27c2b-dfdf-404a-ac66-7e27cbfc875b tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ed27c2b-dfdf-404a-ac66-7e27cbfc875b tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:51 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:23:51 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-526a6d80-c12f-4c98-8820-4a1ce9f8ca99 tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "cinder-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-526a6d80-c12f-4c98-8820-4a1ce9f8ca99 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "cinder-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-526a6d80-c12f-4c98-8820-4a1ce9f8ca99 tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "cinder-quobyte-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-526a6d80-c12f-4c98-8820-4a1ce9f8ca99 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "cinder-quobyte-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:51 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-74e00677-3984-4ca3-8ba7-f2b5153280a8 1073741824" returned: 0 in 0.508s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1e151f-4b4e-454d-999a-08c1f564787d]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-526a6d80-c12f-4c98-8820-4a1ce9f8ca99 tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:51 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2ed27c2b-dfdf-404a-ac66-7e27cbfc875b tempest-CreateVolumesFromImageTest-2087270422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.317s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-2ed27c2b-dfdf-404a-ac66-7e27cbfc875b tempest-CreateVolumesFromImageTest-2087270422 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:23:51 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2ed27c2b-dfdf-404a-ac66-7e27cbfc875b tempest-CreateVolumesFromImageTest-2087270422 None] Deleted volume successfully. Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-74e00677-3984-4ca3-8ba7-f2b5153280a8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2ed27c2b-dfdf-404a-ac66-7e27cbfc875b tempest-CreateVolumesFromImageTest-2087270422 None] Lock "cinder-51491d88-b38d-4a13-8c0e-792ad4a9a073-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:51 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-74e00677-3984-4ca3-8ba7-f2b5153280a8 Sep 01 12:23:51 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:51 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d Sep 01 12:23:51 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:51 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-74e00677-3984-4ca3-8ba7-f2b5153280a8" returned: 0 in 0.283s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.966s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53268c7-3b60-4c2e-9492-93e2ea726b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6367e0138b479aacdd4c6524bad929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:43Z,use_quota=True,user_id='1d04616097684e64ae09f2418f182276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b29a6287-68a8-4944-bc50-ebcd2a52d75d),volume_type_id=b29a6287-68a8-4944-bc50-ebcd2a52d75d)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Creating volume e53268c7-3b60-4c2e-9492-93e2ea726b8e {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:23:51 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd3b7a93-a9a1-4eec-8711-b5066fb74124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74e00677-3984-4ca3-8ba7-f2b5153280a8', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556fe0d7-4095-411c-85b0-a8c2fc6bb5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:51 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:51 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e 1073741824 Sep 01 12:23:51 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-526a6d80-c12f-4c98-8820-4a1ce9f8ca99 tempest-CreateVolumesFromImageTest-2087270422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d" returned: 0 in 0.400s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-526a6d80-c12f-4c98-8820-4a1ce9f8ca99 tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:51 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Volume volume-74e00677-3984-4ca3-8ba7-f2b5153280a8 (74e00677-3984-4ca3-8ba7-f2b5153280a8): created successfully Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556fe0d7-4095-411c-85b0-a8c2fc6bb5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:51 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d Sep 01 12:23:51 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Flow 'volume_create_manager' (fc531370-fc1a-44f6-9f65-d71722941e94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:51 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4a4a53ed-318a-40b9-9483-f2a274f63959 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Created volume successfully. Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c15806c4-75d0-45e9-8970-c904d9cc71bb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "cinder-74e00677-3984-4ca3-8ba7-f2b5153280a8-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c15806c4-75d0-45e9-8970-c904d9cc71bb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-74e00677-3984-4ca3-8ba7-f2b5153280a8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c15806c4-75d0-45e9-8970-c904d9cc71bb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "cinder-quobyte-74e00677-3984-4ca3-8ba7-f2b5153280a8" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c15806c4-75d0-45e9-8970-c904d9cc71bb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-quobyte-74e00677-3984-4ca3-8ba7-f2b5153280a8" acquired by "delete_volume" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0036aea5-d735-4945-ad47-510da4d44d91]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:23:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c15806c4-75d0-45e9-8970-c904d9cc71bb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-74e00677-3984-4ca3-8ba7-f2b5153280a8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:51 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-526a6d80-c12f-4c98-8820-4a1ce9f8ca99 tempest-CreateVolumesFromImageTest-2087270422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d" returned: 0 in 0.314s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-526a6d80-c12f-4c98-8820-4a1ce9f8ca99 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "cinder-quobyte-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d" released by "delete_volume" :: held 0.759s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-526a6d80-c12f-4c98-8820-4a1ce9f8ca99 tempest-CreateVolumesFromImageTest-2087270422 None] Created reservations ['9eb8f24e-39ab-4d2d-a703-122e6cba6695', '8df4f39c-027d-4a84-af96-5b05de31d4f8', '440ed2bf-feea-41f6-b40a-86e7cd3ed719', '0d88be00-3ce1-4c14-857f-1578021216c3'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:23:52 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-74e00677-3984-4ca3-8ba7-f2b5153280a8 Sep 01 12:23:52 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-526a6d80-c12f-4c98-8820-4a1ce9f8ca99 tempest-CreateVolumesFromImageTest-2087270422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-526a6d80-c12f-4c98-8820-4a1ce9f8ca99 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-526a6d80-c12f-4c98-8820-4a1ce9f8ca99 tempest-CreateVolumesFromImageTest-2087270422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-526a6d80-c12f-4c98-8820-4a1ce9f8ca99 tempest-CreateVolumesFromImageTest-2087270422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-526a6d80-c12f-4c98-8820-4a1ce9f8ca99 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-526a6d80-c12f-4c98-8820-4a1ce9f8ca99 tempest-CreateVolumesFromImageTest-2087270422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:52 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e 1073741824" returned: 0 in 0.543s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:52 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:23:52 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:52 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e Sep 01 12:23:52 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:52 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c15806c4-75d0-45e9-8970-c904d9cc71bb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-74e00677-3984-4ca3-8ba7-f2b5153280a8" returned: 0 in 0.448s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c15806c4-75d0-45e9-8970-c904d9cc71bb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-74e00677-3984-4ca3-8ba7-f2b5153280a8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:52 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-526a6d80-c12f-4c98-8820-4a1ce9f8ca99 tempest-CreateVolumesFromImageTest-2087270422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.267s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-526a6d80-c12f-4c98-8820-4a1ce9f8ca99 tempest-CreateVolumesFromImageTest-2087270422 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:23:52 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-74e00677-3984-4ca3-8ba7-f2b5153280a8 Sep 01 12:23:52 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:52 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-526a6d80-c12f-4c98-8820-4a1ce9f8ca99 tempest-CreateVolumesFromImageTest-2087270422 None] Deleted volume successfully. Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-526a6d80-c12f-4c98-8820-4a1ce9f8ca99 tempest-CreateVolumesFromImageTest-2087270422 None] Lock "cinder-8be5e7af-91c1-405a-b4ca-d13a3ab7bd1d-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:52 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e" returned: 0 in 0.311s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.384s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Acquiring lock "cinder-quobyte-caf2c975-8534-484b-9cc0-d96a5f070702-e75aacda-8bf4-409a-b551-e780db93d2a2" by "_create_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Lock "cinder-quobyte-caf2c975-8534-484b-9cc0-d96a5f070702-e75aacda-8bf4-409a-b551-e780db93d2a2" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Creating volume e75aacda-8bf4-409a-b551-e780db93d2a2 from snapshot caf2c975-8534-484b-9cc0-d96a5f070702 {{(pid=87084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Acquiring lock "cinder-quobyte-e75aacda-8bf4-409a-b551-e780db93d2a2" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Attempting download of 25762d67-40a5-4f0d-9545-7829c2066422 ((None, [{'url': 'file:///opt/stack/data/glance/images/25762d67-40a5-4f0d-9545-7829c2066422', 'metadata': {}}])) to volume e53268c7-3b60-4c2e-9492-93e2ea726b8e. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Lock "cinder-quobyte-e75aacda-8bf4-409a-b551-e780db93d2a2" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] snapshot: caf2c975-8534-484b-9cc0-d96a5f070702, volume: e75aacda-8bf4-409a-b551-e780db93d2a2, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d0844a-c052-4d66-9ae5-1291c3aa25ce]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:23:52 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25762d67-40a5-4f0d-9545-7829c2066422_lzcu9bzs {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc0e66a-d49b-4428-ab8c-62bf15d84882]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c15806c4-75d0-45e9-8970-c904d9cc71bb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-74e00677-3984-4ca3-8ba7-f2b5153280a8" returned: 0 in 0.321s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c15806c4-75d0-45e9-8970-c904d9cc71bb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-quobyte-74e00677-3984-4ca3-8ba7-f2b5153280a8" released by "delete_volume" :: held 0.813s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c15806c4-75d0-45e9-8970-c904d9cc71bb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Created reservations ['625de61e-17cf-48bd-98f2-3bb626291bd2', '5cb54d25-6884-40b4-9839-1e41d8b33d46', 'e30a4f86-4821-41a7-afb8-b0d4924c2a08', '2ddfb9da-9e63-44b8-b5d0-df4515599641'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:23:52 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25762d67-40a5-4f0d-9545-7829c2066422_lzcu9bzs Sep 01 12:23:52 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:52 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702 Sep 01 12:23:52 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c15806c4-75d0-45e9-8970-c904d9cc71bb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c15806c4-75d0-45e9-8970-c904d9cc71bb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c15806c4-75d0-45e9-8970-c904d9cc71bb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c15806c4-75d0-45e9-8970-c904d9cc71bb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c15806c4-75d0-45e9-8970-c904d9cc71bb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c15806c4-75d0-45e9-8970-c904d9cc71bb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:52 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:23:52 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f4e86c89-e642-4ecc-8de6-c0067f2130a9 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "cinder-ffe26fc6-5402-4197-a914-6c2243773d5f-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f4e86c89-e642-4ecc-8de6-c0067f2130a9 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-ffe26fc6-5402-4197-a914-6c2243773d5f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:53 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25762d67-40a5-4f0d-9545-7829c2066422_lzcu9bzs" returned: 0 in 0.400s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25762d67-40a5-4f0d-9545-7829c2066422_lzcu9bzs {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f4e86c89-e642-4ecc-8de6-c0067f2130a9 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "cinder-quobyte-ffe26fc6-5402-4197-a914-6c2243773d5f" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f4e86c89-e642-4ecc-8de6-c0067f2130a9 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-quobyte-ffe26fc6-5402-4197-a914-6c2243773d5f" acquired by "delete_volume" :: waited 0.034s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5509b046-8e70-4e42-bed7-1afffccd1d81]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4e86c89-e642-4ecc-8de6-c0067f2130a9 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ffe26fc6-5402-4197-a914-6c2243773d5f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:53 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c15806c4-75d0-45e9-8970-c904d9cc71bb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.369s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c15806c4-75d0-45e9-8970-c904d9cc71bb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:23:53 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c15806c4-75d0-45e9-8970-c904d9cc71bb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Deleted volume successfully. Sep 01 12:23:53 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702" returned: 0 in 0.569s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f61d421-1873-4f9b-9dab-f5fb610d4c23]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:53 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25762d67-40a5-4f0d-9545-7829c2066422_lzcu9bzs Sep 01 12:23:53 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c15806c4-75d0-45e9-8970-c904d9cc71bb tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-74e00677-3984-4ca3-8ba7-f2b5153280a8-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:53 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ffe26fc6-5402-4197-a914-6c2243773d5f Sep 01 12:23:53 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:53 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 Sep 01 12:23:53 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:53 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25762d67-40a5-4f0d-9545-7829c2066422_lzcu9bzs" returned: 1 in 0.506s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25762d67-40a5-4f0d-9545-7829c2066422_lzcu9bzs' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4867ac5-cea8-4287-adcc-bae0ad29c781]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:53 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4e86c89-e642-4ecc-8de6-c0067f2130a9 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ffe26fc6-5402-4197-a914-6c2243773d5f" returned: 0 in 0.470s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4e86c89-e642-4ecc-8de6-c0067f2130a9 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ffe26fc6-5402-4197-a914-6c2243773d5f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:53 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ffe26fc6-5402-4197-a914-6c2243773d5f Sep 01 12:23:53 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:53 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD Sep 01 12:23:53 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:53 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19" returned: 0 in 0.520s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Path /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e75aacda-8bf4-409a-b551-e780db93d2a2 not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:23:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e75aacda-8bf4-409a-b551-e780db93d2a2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:53 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e75aacda-8bf4-409a-b551-e780db93d2a2 Sep 01 12:23:53 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:54 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD" returned: 0 in 0.425s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:54 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4e86c89-e642-4ecc-8de6-c0067f2130a9 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-ffe26fc6-5402-4197-a914-6c2243773d5f" returned: 0 in 0.362s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f4e86c89-e642-4ecc-8de6-c0067f2130a9 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-quobyte-ffe26fc6-5402-4197-a914-6c2243773d5f" released by "delete_volume" :: held 0.889s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-f4e86c89-e642-4ecc-8de6-c0067f2130a9 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Created reservations ['04c0f8ac-69f6-409d-87ca-a3890c9053f4', 'f7097eb9-6da7-4638-b1b7-aa3557db4769', '0ea7b491-3494-4c96-9e24-1b832520338d', '86abb79f-c9fd-435e-86c7-5e913da89b92'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:23:54 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD Sep 01 12:23:54 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f4e86c89-e642-4ecc-8de6-c0067f2130a9 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f4e86c89-e642-4ecc-8de6-c0067f2130a9 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f4e86c89-e642-4ecc-8de6-c0067f2130a9 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f4e86c89-e642-4ecc-8de6-c0067f2130a9 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f4e86c89-e642-4ecc-8de6-c0067f2130a9 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4e86c89-e642-4ecc-8de6-c0067f2130a9 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:54 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:23:54 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-90a1409a-7351-45f6-bb47-a998161c04b3 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "cinder-c73689d8-a42a-4670-9178-3558dd917552-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-90a1409a-7351-45f6-bb47-a998161c04b3 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-c73689d8-a42a-4670-9178-3558dd917552-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-90a1409a-7351-45f6-bb47-a998161c04b3 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "cinder-quobyte-c73689d8-a42a-4670-9178-3558dd917552" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-90a1409a-7351-45f6-bb47-a998161c04b3 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-quobyte-c73689d8-a42a-4670-9178-3558dd917552" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e13a67-ed7c-41cd-8d11-4a590fe6a447]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90a1409a-7351-45f6-bb47-a998161c04b3 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c73689d8-a42a-4670-9178-3558dd917552 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:54 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD" returned: 1 in 0.584s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] 25762d67-40a5-4f0d-9545-7829c2066422 was raw, converting to qcow2 {{(pid=87084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:54 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f4e86c89-e642-4ecc-8de6-c0067f2130a9 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.411s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-f4e86c89-e642-4ecc-8de6-c0067f2130a9 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:23:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f4e86c89-e642-4ecc-8de6-c0067f2130a9 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Deleted volume successfully. Sep 01 12:23:54 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e Sep 01 12:23:54 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:54 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f4e86c89-e642-4ecc-8de6-c0067f2130a9 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-ffe26fc6-5402-4197-a914-6c2243773d5f-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:54 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c73689d8-a42a-4670-9178-3558dd917552 Sep 01 12:23:54 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:55 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90a1409a-7351-45f6-bb47-a998161c04b3 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c73689d8-a42a-4670-9178-3558dd917552" returned: 0 in 1.116s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90a1409a-7351-45f6-bb47-a998161c04b3 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c73689d8-a42a-4670-9178-3558dd917552 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:55 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c73689d8-a42a-4670-9178-3558dd917552 Sep 01 12:23:55 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:55 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e" returned: 0 in 1.279s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:55 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25762d67-40a5-4f0d-9545-7829c2066422_0eumved7devstack@QuobyteHD, size 0.00 MB, duration 1.28 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:23:55 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 12:23:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:55 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e 1G Sep 01 12:23:55 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:56 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90a1409a-7351-45f6-bb47-a998161c04b3 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-c73689d8-a42a-4670-9178-3558dd917552" returned: 0 in 0.640s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-90a1409a-7351-45f6-bb47-a998161c04b3 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-quobyte-c73689d8-a42a-4670-9178-3558dd917552" released by "delete_volume" :: held 1.830s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:56 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-90a1409a-7351-45f6-bb47-a998161c04b3 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Created reservations ['7cadc5fb-93a7-45a8-966e-9ca7da73668e', 'a80f3b27-069d-452f-bfd5-e9e370a5cabd', 'cc522973-2cbf-4cb5-8465-13689fbb7129', 'ef955e0d-758d-415d-a5a8-c35a240466e5'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:23:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-90a1409a-7351-45f6-bb47-a998161c04b3 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-90a1409a-7351-45f6-bb47-a998161c04b3 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-90a1409a-7351-45f6-bb47-a998161c04b3 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-90a1409a-7351-45f6-bb47-a998161c04b3 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-90a1409a-7351-45f6-bb47-a998161c04b3 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90a1409a-7351-45f6-bb47-a998161c04b3 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:56 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:23:56 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1b8d8507-2d79-41f7-bd43-b2c7a0c16f83 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "cinder-24b5ebfb-3245-437f-a156-b7dd81b3e65b-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:56 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e 1G" returned: 0 in 0.940s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:56 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Downloaded image 25762d67-40a5-4f0d-9545-7829c2066422 ((None, [{'url': 'file:///opt/stack/data/glance/images/25762d67-40a5-4f0d-9545-7829c2066422', 'metadata': {}}])) to volume e53268c7-3b60-4c2e-9492-93e2ea726b8e successfully. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 12:23:56 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Temporary image 25762d67-40a5-4f0d-9545-7829c2066422 for user 1d04616097684e64ae09f2418f182276 is deleted. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 12:23:56 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Marking volume e53268c7-3b60-4c2e-9492-93e2ea726b8e as bootable. {{(pid=87084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 12:23:56 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1b8d8507-2d79-41f7-bd43-b2c7a0c16f83 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-24b5ebfb-3245-437f-a156-b7dd81b3e65b-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:56 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Copying metadata from image 25762d67-40a5-4f0d-9545-7829c2066422 to e53268c7-3b60-4c2e-9492-93e2ea726b8e. {{(pid=87084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 12:23:56 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Creating volume glance metadata for volume e53268c7-3b60-4c2e-9492-93e2ea726b8e backed by image 25762d67-40a5-4f0d-9545-7829c2066422 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '25762d67-40a5-4f0d-9545-7829c2066422', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'aca6cf0697b22dce584fdec52a670911', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 12:23:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1b8d8507-2d79-41f7-bd43-b2c7a0c16f83 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "cinder-quobyte-24b5ebfb-3245-437f-a156-b7dd81b3e65b" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1b8d8507-2d79-41f7-bd43-b2c7a0c16f83 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-quobyte-24b5ebfb-3245-437f-a156-b7dd81b3e65b" acquired by "delete_volume" :: waited 0.035s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:57 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[156370b6-c445-4416-bf98-a6e961246dde]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:23:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1b8d8507-2d79-41f7-bd43-b2c7a0c16f83 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-24b5ebfb-3245-437f-a156-b7dd81b3e65b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce1d79a-5ccc-4232-9c9a-74a74ca1d27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e', 'volume_size': 1, 'image_id': '25762d67-40a5-4f0d-9545-7829c2066422', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25762d67-40a5-4f0d-9545-7829c2066422', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aca6cf0697b22dce584fdec52a670911', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7e6367e0138b479aacdd4c6524bad929', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '02d701cc31a81fbd37240233a442ed598625ae02a134c28e4ad5ecd50c17be315e41cb1d718117fbfe35a3d214741f64b6461102ceb36064bafef57da9693d0a', 'id': '25762d67-40a5-4f0d-9545-7829c2066422', 'created_at': datetime.datetime(2026, 9, 1, 10, 23, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25762d67-40a5-4f0d-9545-7829c2066422/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61750b4f-e0ee-48a9-891a-892ca2609b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:57 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Volume volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e (e53268c7-3b60-4c2e-9492-93e2ea726b8e): created successfully Sep 01 12:23:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61750b4f-e0ee-48a9-891a-892ca2609b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:57 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Flow 'volume_create_manager' (f18ee690-5532-4332-9487-db888a3d6ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7db2b86d-a50f-479c-bcbd-c57b41141bb5 tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Created volume successfully. Sep 01 12:23:57 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-90a1409a-7351-45f6-bb47-a998161c04b3 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.785s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:57 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-90a1409a-7351-45f6-bb47-a998161c04b3 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:23:57 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-90a1409a-7351-45f6-bb47-a998161c04b3 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Deleted volume successfully. Sep 01 12:23:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-90a1409a-7351-45f6-bb47-a998161c04b3 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-c73689d8-a42a-4670-9178-3558dd917552-delete_volume" released by "delete_volume" :: held 3.163s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:57 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-24b5ebfb-3245-437f-a156-b7dd81b3e65b Sep 01 12:23:57 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:58 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1b8d8507-2d79-41f7-bd43-b2c7a0c16f83 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-24b5ebfb-3245-437f-a156-b7dd81b3e65b" returned: 0 in 1.242s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1b8d8507-2d79-41f7-bd43-b2c7a0c16f83 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-24b5ebfb-3245-437f-a156-b7dd81b3e65b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:58 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-24b5ebfb-3245-437f-a156-b7dd81b3e65b Sep 01 12:23:58 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:58 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:23:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Flow 'volume_create_manager' (6f884a0a-0db4-40fe-bad6-dc5a9b47b3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:23:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91159e6e-def1-4a21-83dd-440ea83abc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91159e6e-def1-4a21-83dd-440ea83abc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-879711310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7edcefc5-e31a-43db-bfd3-b02334e9a678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9993774c8b5d480694dbfea5fcda625d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:58Z,use_quota=True,user_id='c5f607b502bd437490d8dea89b36fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345bb503-a606-4575-8c99-1c303d05aa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345bb503-a606-4575-8c99-1c303d05aa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa40fad7-06bc-496b-9ecc-4109bd079d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa40fad7-06bc-496b-9ecc-4109bd079d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7edcefc5-e31a-43db-bfd3-b02334e9a678', 'volume_name': 'volume-7edcefc5-e31a-43db-bfd3-b02334e9a678', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f186c4-0edf-430f-98fa-fb713dfb9ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f186c4-0edf-430f-98fa-fb713dfb9ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:23:58 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d52909-6380-4752-a5e5-0ab52d4b68d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:23:58 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Volume 7edcefc5-e31a-43db-bfd3-b02334e9a678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7edcefc5-e31a-43db-bfd3-b02334e9a678', 'volume_size': 1} Sep 01 12:23:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ed6ce6f1-02ff-4d1f-8c8b-a03b9a3763fc tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Acquiring lock "cinder-e53268c7-3b60-4c2e-9492-93e2ea726b8e-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ed6ce6f1-02ff-4d1f-8c8b-a03b9a3763fc tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Lock "cinder-e53268c7-3b60-4c2e-9492-93e2ea726b8e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ed6ce6f1-02ff-4d1f-8c8b-a03b9a3763fc tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Acquiring lock "cinder-quobyte-e53268c7-3b60-4c2e-9492-93e2ea726b8e" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:23:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ed6ce6f1-02ff-4d1f-8c8b-a03b9a3763fc tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Lock "cinder-quobyte-e53268c7-3b60-4c2e-9492-93e2ea726b8e" acquired by "delete_volume" :: waited 0.065s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:23:58 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d1a189-59ea-44e5-97dc-42034d438999]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:23:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ed6ce6f1-02ff-4d1f-8c8b-a03b9a3763fc tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:59 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1b8d8507-2d79-41f7-bd43-b2c7a0c16f83 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-24b5ebfb-3245-437f-a156-b7dd81b3e65b" returned: 0 in 0.693s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1b8d8507-2d79-41f7-bd43-b2c7a0c16f83 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-quobyte-24b5ebfb-3245-437f-a156-b7dd81b3e65b" released by "delete_volume" :: held 2.061s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:23:59 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e Sep 01 12:23:59 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:59 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-1b8d8507-2d79-41f7-bd43-b2c7a0c16f83 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Created reservations ['ff3e7389-f6ac-43e6-8a2a-2e9211197ec6', '8df3b059-ca71-448f-94dd-207f3315da26', 'e500f317-4118-4e24-b6a9-b980552fae30', 'ae03fb6f-b29d-4dda-91cd-bd2a466f2296'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:23:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1b8d8507-2d79-41f7-bd43-b2c7a0c16f83 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:23:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1b8d8507-2d79-41f7-bd43-b2c7a0c16f83 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:23:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1b8d8507-2d79-41f7-bd43-b2c7a0c16f83 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:23:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1b8d8507-2d79-41f7-bd43-b2c7a0c16f83 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:23:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1b8d8507-2d79-41f7-bd43-b2c7a0c16f83 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:23:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1b8d8507-2d79-41f7-bd43-b2c7a0c16f83 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:59 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:23:59 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:59 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ed6ce6f1-02ff-4d1f-8c8b-a03b9a3763fc tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e" returned: 0 in 0.832s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ed6ce6f1-02ff-4d1f-8c8b-a03b9a3763fc tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:59 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e Sep 01 12:23:59 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:59 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e75aacda-8bf4-409a-b551-e780db93d2a2" returned: 0 in 6.017s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:59 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e75aacda-8bf4-409a-b551-e780db93d2a2 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:23:59 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Converted 1024.00 MB image at 170.16 MB/s Sep 01 12:23:59 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e75aacda-8bf4-409a-b551-e780db93d2a2 is being set with open permissions: ugo+rw Sep 01 12:23:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e75aacda-8bf4-409a-b551-e780db93d2a2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:23:59 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e75aacda-8bf4-409a-b551-e780db93d2a2 Sep 01 12:23:59 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:23:59 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Sep 01 12:23:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1b8d8507-2d79-41f7-bd43-b2c7a0c16f83 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.357s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:23:59 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-1b8d8507-2d79-41f7-bd43-b2c7a0c16f83 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:23:59 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1b8d8507-2d79-41f7-bd43-b2c7a0c16f83 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Deleted volume successfully. Sep 01 12:23:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1b8d8507-2d79-41f7-bd43-b2c7a0c16f83 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-24b5ebfb-3245-437f-a156-b7dd81b3e65b-delete_volume" released by "delete_volume" :: held 3.032s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:00 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ed6ce6f1-02ff-4d1f-8c8b-a03b9a3763fc tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e53268c7-3b60-4c2e-9492-93e2ea726b8e" returned: 0 in 0.264s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ed6ce6f1-02ff-4d1f-8c8b-a03b9a3763fc tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Lock "cinder-quobyte-e53268c7-3b60-4c2e-9492-93e2ea726b8e" released by "delete_volume" :: held 1.161s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:00 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-ed6ce6f1-02ff-4d1f-8c8b-a03b9a3763fc tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Created reservations ['914e3d25-87e3-49db-b9e6-35fceb21ceeb', '6ee7a93f-8c13-4587-86fa-dfad26f4a1b4', '83259199-2aaa-4675-b3b6-21b5c9fa6409', '6b9feb1f-8156-405d-8373-7c3560cc5812'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e75aacda-8bf4-409a-b551-e780db93d2a2" returned: 0 in 0.295s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Lock "cinder-quobyte-e75aacda-8bf4-409a-b551-e780db93d2a2" released by "_copy_volume_from_snapshot" :: held 7.549s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Lock "cinder-quobyte-caf2c975-8534-484b-9cc0-d96a5f070702-e75aacda-8bf4-409a-b551-e780db93d2a2" released by "_create_volume_from_snapshot" :: held 7.636s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.665s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.519s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-879711310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7edcefc5-e31a-43db-bfd3-b02334e9a678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9993774c8b5d480694dbfea5fcda625d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:23:58Z,use_quota=True,user_id='c5f607b502bd437490d8dea89b36fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Creating volume 7edcefc5-e31a-43db-bfd3-b02334e9a678 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:24:00 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:00 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678 1073741824 Sep 01 12:24:00 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98121d1-cf15-4e75-b310-2ff719598355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e75aacda-8bf4-409a-b551-e780db93d2a2', 'volume_size': 1, 'snapshot_id': 'caf2c975-8534-484b-9cc0-d96a5f070702'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532c946f-d215-4ecf-8d41-7401c969af20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ed6ce6f1-02ff-4d1f-8c8b-a03b9a3763fc tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ed6ce6f1-02ff-4d1f-8c8b-a03b9a3763fc tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ed6ce6f1-02ff-4d1f-8c8b-a03b9a3763fc tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ed6ce6f1-02ff-4d1f-8c8b-a03b9a3763fc tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ed6ce6f1-02ff-4d1f-8c8b-a03b9a3763fc tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ed6ce6f1-02ff-4d1f-8c8b-a03b9a3763fc tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:00 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Volume volume-e75aacda-8bf4-409a-b551-e780db93d2a2 (e75aacda-8bf4-409a-b551-e780db93d2a2): created successfully Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532c946f-d215-4ecf-8d41-7401c969af20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Flow 'volume_create_manager' (e68d455d-c404-4c69-b3d9-8d0a5c815d19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:00 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:00 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:00 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8f198e74-a4f8-44e1-bbb2-10201f379a2c tempest-VolumeDependencyTests-1858620102 None] Created volume successfully. Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-277f89a7-9a44-4c63-a00f-40e4346328e4 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "cinder-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-277f89a7-9a44-4c63-a00f-40e4346328e4 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-277f89a7-9a44-4c63-a00f-40e4346328e4 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "cinder-quobyte-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-277f89a7-9a44-4c63-a00f-40e4346328e4 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-quobyte-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7" acquired by "delete_volume" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4254df1-3f19-4964-8755-795b7eb7fcc9]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-277f89a7-9a44-4c63-a00f-40e4346328e4 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:00 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7 Sep 01 12:24:00 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:00 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ed6ce6f1-02ff-4d1f-8c8b-a03b9a3763fc tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.320s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-ed6ce6f1-02ff-4d1f-8c8b-a03b9a3763fc tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:00 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ed6ce6f1-02ff-4d1f-8c8b-a03b9a3763fc tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Deleted volume successfully. Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ed6ce6f1-02ff-4d1f-8c8b-a03b9a3763fc tempest-VolumeAndVolumeTypeFromImageTest-1172122308 None] Lock "cinder-e53268c7-3b60-4c2e-9492-93e2ea726b8e-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:00 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678 1073741824" returned: 0 in 0.471s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:00 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678 Sep 01 12:24:00 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:00 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-277f89a7-9a44-4c63-a00f-40e4346328e4 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7" returned: 0 in 0.376s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-277f89a7-9a44-4c63-a00f-40e4346328e4 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:00 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7 Sep 01 12:24:00 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:00 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678" returned: 0 in 0.254s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d52909-6380-4752-a5e5-0ab52d4b68d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7edcefc5-e31a-43db-bfd3-b02334e9a678', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bec3ba8-cf4a-4ad2-b3fa-682ffed44092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:00 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Volume volume-7edcefc5-e31a-43db-bfd3-b02334e9a678 (7edcefc5-e31a-43db-bfd3-b02334e9a678): created successfully Sep 01 12:24:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bec3ba8-cf4a-4ad2-b3fa-682ffed44092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Flow 'volume_create_manager' (6f884a0a-0db4-40fe-bad6-dc5a9b47b3f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:01 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f1753eda-8f8e-499a-908c-b96822fd3583 tempest-CreateVolumesFromSnapshotTest-51667841 None] Created volume successfully. Sep 01 12:24:01 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-277f89a7-9a44-4c63-a00f-40e4346328e4 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7" returned: 0 in 0.273s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-277f89a7-9a44-4c63-a00f-40e4346328e4 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-quobyte-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7" released by "delete_volume" :: held 0.699s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] Acquiring lock "cinder-caf2c975-8534-484b-9cc0-d96a5f070702-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] Lock "cinder-caf2c975-8534-484b-9cc0-d96a5f070702-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] Acquiring lock "cinder-quobyte-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-277f89a7-9a44-4c63-a00f-40e4346328e4 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Created reservations ['6dd7eecb-35d0-4dbe-81e9-e945740d0683', '4b623a42-5937-4df2-a8f7-7795ac1e289e', '70165b66-3e9e-4f0f-8b2b-8ddfaa9062d8', 'abed8adb-908c-4dc4-ad06-641e2e353c20'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] Lock "cinder-quobyte-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] Acquiring lock "cinder-quobyte-caf2c975-8534-484b-9cc0-d96a5f070702" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] Lock "cinder-quobyte-caf2c975-8534-484b-9cc0-d96a5f070702" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] Deleting offline snapshot caf2c975-8534-484b-9cc0-d96a5f070702 of volume a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] snapshot_file for this snap is: volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[307ecd44-ea23-4b7c-8c47-bef64ef74d44]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-277f89a7-9a44-4c63-a00f-40e4346328e4 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-277f89a7-9a44-4c63-a00f-40e4346328e4 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-277f89a7-9a44-4c63-a00f-40e4346328e4 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-277f89a7-9a44-4c63-a00f-40e4346328e4 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-277f89a7-9a44-4c63-a00f-40e4346328e4 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-277f89a7-9a44-4c63-a00f-40e4346328e4 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:01 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:01 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:01 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702 Sep 01 12:24:01 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2b2e7f8b-ebe5-4091-a70f-ef321127470a tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "cinder-bad82a4e-c1e8-4252-abe6-78c6f8568efc-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2b2e7f8b-ebe5-4091-a70f-ef321127470a tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-bad82a4e-c1e8-4252-abe6-78c6f8568efc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2b2e7f8b-ebe5-4091-a70f-ef321127470a tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "cinder-quobyte-bad82a4e-c1e8-4252-abe6-78c6f8568efc" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2b2e7f8b-ebe5-4091-a70f-ef321127470a tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-quobyte-bad82a4e-c1e8-4252-abe6-78c6f8568efc" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c514b3-3246-40b3-9ff2-b2ef4b0ce0a9]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2b2e7f8b-ebe5-4091-a70f-ef321127470a tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bad82a4e-c1e8-4252-abe6-78c6f8568efc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:01 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-277f89a7-9a44-4c63-a00f-40e4346328e4 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.368s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-277f89a7-9a44-4c63-a00f-40e4346328e4 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:01 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:01 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-277f89a7-9a44-4c63-a00f-40e4346328e4 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Deleted volume successfully. Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702" returned: 0 in 0.445s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[760b1fed-cd35-4e62-a2eb-aba8a0722e5d]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-277f89a7-9a44-4c63-a00f-40e4346328e4 tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-e5a7c85a-3d33-41b9-8aa1-f2e70ebe8ee7-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:01 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bad82a4e-c1e8-4252-abe6-78c6f8568efc Sep 01 12:24:01 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:01 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 Sep 01 12:24:01 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5dae88fd-368c-4825-aec0-4302ae986b22 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5dae88fd-368c-4825-aec0-4302ae986b22 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5dae88fd-368c-4825-aec0-4302ae986b22 tempest-CreateVolumesFromSnapshotTest-51667841 None] Creating offline snapshot 7a4526ab-f4b8-47b9-b77a-b5b0a3441195 of volume 7edcefc5-e31a-43db-bfd3-b02334e9a678 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:24:02 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e702e2-bf80-41ab-8fd9-f48d7c16d665]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dae88fd-368c-4825-aec0-4302ae986b22 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:02 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2b2e7f8b-ebe5-4091-a70f-ef321127470a tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bad82a4e-c1e8-4252-abe6-78c6f8568efc" returned: 0 in 0.502s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2b2e7f8b-ebe5-4091-a70f-ef321127470a tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bad82a4e-c1e8-4252-abe6-78c6f8568efc {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:02 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bad82a4e-c1e8-4252-abe6-78c6f8568efc Sep 01 12:24:02 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:02 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678 Sep 01 12:24:02 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:02 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2b2e7f8b-ebe5-4091-a70f-ef321127470a tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-bad82a4e-c1e8-4252-abe6-78c6f8568efc" returned: 0 in 0.267s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:02 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2b2e7f8b-ebe5-4091-a70f-ef321127470a tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-quobyte-bad82a4e-c1e8-4252-abe6-78c6f8568efc" released by "delete_volume" :: held 0.825s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19" returned: 0 in 0.701s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:02 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702 Sep 01 12:24:02 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:02 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-2b2e7f8b-ebe5-4091-a70f-ef321127470a tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Created reservations ['482986a7-ce41-4978-afef-10151ece53ca', '15925fcc-f4aa-4c3f-9cb2-8276acc33161', 'd389cac2-3585-4592-8049-3328bf070760', '71215266-1d91-4955-ab94-3bd95bc7b139'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:02 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dae88fd-368c-4825-aec0-4302ae986b22 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678" returned: 0 in 0.448s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dae88fd-368c-4825-aec0-4302ae986b22 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.7a4526ab-f4b8-47b9-b77a-b5b0a3441195 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:02 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.7a4526ab-f4b8-47b9-b77a-b5b0a3441195 1G Sep 01 12:24:02 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2b2e7f8b-ebe5-4091-a70f-ef321127470a tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2b2e7f8b-ebe5-4091-a70f-ef321127470a tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2b2e7f8b-ebe5-4091-a70f-ef321127470a tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2b2e7f8b-ebe5-4091-a70f-ef321127470a tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2b2e7f8b-ebe5-4091-a70f-ef321127470a tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2b2e7f8b-ebe5-4091-a70f-ef321127470a tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:02 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:02 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:03 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702" returned: 0 in 0.563s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:03 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702 Sep 01 12:24:03 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:03 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2b2e7f8b-ebe5-4091-a70f-ef321127470a tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.440s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:03 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-2b2e7f8b-ebe5-4091-a70f-ef321127470a tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2b2e7f8b-ebe5-4091-a70f-ef321127470a tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Deleted volume successfully. Sep 01 12:24:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2b2e7f8b-ebe5-4091-a70f-ef321127470a tempest-CreateVolumesFromSourceVolumeTest-1879526411 None] Lock "cinder-bad82a4e-c1e8-4252-abe6-78c6f8568efc-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:03 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dae88fd-368c-4825-aec0-4302ae986b22 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.7a4526ab-f4b8-47b9-b77a-b5b0a3441195 1G" returned: 0 in 0.678s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dae88fd-368c-4825-aec0-4302ae986b22 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7edcefc5-e31a-43db-bfd3-b02334e9a678 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.7a4526ab-f4b8-47b9-b77a-b5b0a3441195 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:03 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7edcefc5-e31a-43db-bfd3-b02334e9a678 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.7a4526ab-f4b8-47b9-b77a-b5b0a3441195 Sep 01 12:24:03 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:03 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19.caf2c975-8534-484b-9cc0-d96a5f070702" returned: 0 in 0.357s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] Lock "cinder-quobyte-caf2c975-8534-484b-9cc0-d96a5f070702" released by "_delete_snapshot" :: held 2.210s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] Lock "cinder-quobyte-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19" released by "delete_snapshot" :: held 2.244s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:03 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] Created reservations ['a942a6d0-d847-41bd-b4a9-dd473f470620', 'a2a6ec03-4862-4953-be63-e3f82d12919c', 'fa48ba91-01a3-4008-869b-75b4fc447615', '2a393a75-5369-4fcb-8ded-9551e050173d'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:03 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] Delete snapshot completed successfully. Sep 01 12:24:03 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5fbfa3df-0a66-48fc-a49a-f9256d7bd564 tempest-VolumeDependencyTests-1858620102 None] Lock "cinder-caf2c975-8534-484b-9cc0-d96a5f070702-delete_snapshot" released by "delete_snapshot" :: held 2.410s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:03 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dae88fd-368c-4825-aec0-4302ae986b22 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7edcefc5-e31a-43db-bfd3-b02334e9a678 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.7a4526ab-f4b8-47b9-b77a-b5b0a3441195" returned: 0 in 0.439s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:03 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-5dae88fd-368c-4825-aec0-4302ae986b22 tempest-CreateVolumesFromSnapshotTest-51667841 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.7a4526ab-f4b8-47b9-b77a-b5b0a3441195 is being set with open permissions: ugo+rw Sep 01 12:24:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dae88fd-368c-4825-aec0-4302ae986b22 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.7a4526ab-f4b8-47b9-b77a-b5b0a3441195 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:03 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.7a4526ab-f4b8-47b9-b77a-b5b0a3441195 Sep 01 12:24:03 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:04 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dae88fd-368c-4825-aec0-4302ae986b22 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.7a4526ab-f4b8-47b9-b77a-b5b0a3441195" returned: 0 in 0.280s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dae88fd-368c-4825-aec0-4302ae986b22 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:04 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.info Sep 01 12:24:04 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:04 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dae88fd-368c-4825-aec0-4302ae986b22 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.info" returned: 0 in 0.308s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:04 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-5dae88fd-368c-4825-aec0-4302ae986b22 tempest-CreateVolumesFromSnapshotTest-51667841 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.info is being set with open permissions: ugo+rw Sep 01 12:24:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dae88fd-368c-4825-aec0-4302ae986b22 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:04 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.info Sep 01 12:24:04 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ee617d7e-e310-4706-b176-65803c83c705 tempest-VolumeDependencyTests-1858620102 None] Acquiring lock "cinder-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ee617d7e-e310-4706-b176-65803c83c705 tempest-VolumeDependencyTests-1858620102 None] Lock "cinder-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ee617d7e-e310-4706-b176-65803c83c705 tempest-VolumeDependencyTests-1858620102 None] Acquiring lock "cinder-quobyte-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ee617d7e-e310-4706-b176-65803c83c705 tempest-VolumeDependencyTests-1858620102 None] Lock "cinder-quobyte-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19" acquired by "delete_volume" :: waited 0.034s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:04 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4b8865-9c28-4015-8bd9-4df2edf300c9]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee617d7e-e310-4706-b176-65803c83c705 tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:04 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5dae88fd-368c-4825-aec0-4302ae986b22 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.info" returned: 0 in 0.341s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5dae88fd-368c-4825-aec0-4302ae986b22 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.617s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:04 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5dae88fd-368c-4825-aec0-4302ae986b22 tempest-CreateVolumesFromSnapshotTest-51667841 None] Create snapshot completed successfully Sep 01 12:24:04 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 Sep 01 12:24:04 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:05 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee617d7e-e310-4706-b176-65803c83c705 tempest-VolumeDependencyTests-1858620102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19" returned: 0 in 0.440s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee617d7e-e310-4706-b176-65803c83c705 tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:05 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19 Sep 01 12:24:05 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:05 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee617d7e-e310-4706-b176-65803c83c705 tempest-VolumeDependencyTests-1858620102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19" returned: 0 in 0.275s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ee617d7e-e310-4706-b176-65803c83c705 tempest-VolumeDependencyTests-1858620102 None] Lock "cinder-quobyte-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19" released by "delete_volume" :: held 0.804s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:05 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-ee617d7e-e310-4706-b176-65803c83c705 tempest-VolumeDependencyTests-1858620102 None] Created reservations ['ecbb8f5e-6a9d-48e3-ba8a-f92101fb175d', '822ffb98-516c-43ab-9b10-bb832e45b66f', 'edbffb29-5dc4-4bfe-92d9-aea85e99ba4d', '0dc17ee2-08b0-408d-99b4-91e25fb186d6'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ee617d7e-e310-4706-b176-65803c83c705 tempest-VolumeDependencyTests-1858620102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ee617d7e-e310-4706-b176-65803c83c705 tempest-VolumeDependencyTests-1858620102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ee617d7e-e310-4706-b176-65803c83c705 tempest-VolumeDependencyTests-1858620102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ee617d7e-e310-4706-b176-65803c83c705 tempest-VolumeDependencyTests-1858620102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ee617d7e-e310-4706-b176-65803c83c705 tempest-VolumeDependencyTests-1858620102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee617d7e-e310-4706-b176-65803c83c705 tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:05 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:05 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c50e8643-3311-40d0-ba32-230b532d518b tempest-VolumeDependencyTests-1858620102 None] Acquiring lock "cinder-e75aacda-8bf4-409a-b551-e780db93d2a2-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c50e8643-3311-40d0-ba32-230b532d518b tempest-VolumeDependencyTests-1858620102 None] Lock "cinder-e75aacda-8bf4-409a-b551-e780db93d2a2-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:05 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ee617d7e-e310-4706-b176-65803c83c705 tempest-VolumeDependencyTests-1858620102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.394s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:05 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-ee617d7e-e310-4706-b176-65803c83c705 tempest-VolumeDependencyTests-1858620102 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:05 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ee617d7e-e310-4706-b176-65803c83c705 tempest-VolumeDependencyTests-1858620102 None] Deleted volume successfully. Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c50e8643-3311-40d0-ba32-230b532d518b tempest-VolumeDependencyTests-1858620102 None] Acquiring lock "cinder-quobyte-e75aacda-8bf4-409a-b551-e780db93d2a2" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ee617d7e-e310-4706-b176-65803c83c705 tempest-VolumeDependencyTests-1858620102 None] Lock "cinder-a55fe7b3-a1bb-47b8-8389-8a42f7a2ae19-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c50e8643-3311-40d0-ba32-230b532d518b tempest-VolumeDependencyTests-1858620102 None] Lock "cinder-quobyte-e75aacda-8bf4-409a-b551-e780db93d2a2" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Flow 'volume_create_manager' (e2e3a5c6-c5c9-4414-b3e6-33aeba3a12c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (299e1883-78e1-418a-a2e8-f32e83453cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[16007b10-1641-493d-b150-63ba7453cdc1]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c50e8643-3311-40d0-ba32-230b532d518b tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e75aacda-8bf4-409a-b551-e780db93d2a2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (299e1883-78e1-418a-a2e8-f32e83453cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-698031839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=897a36ed-4a13-493a-9546-8ce787d09944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9993774c8b5d480694dbfea5fcda625d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:06Z,use_quota=True,user_id='c5f607b502bd437490d8dea89b36fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373fa9a0-54ad-47cd-a52a-e85daade7a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373fa9a0-54ad-47cd-a52a-e85daade7a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0447200-91f8-44ac-a1c7-390c7ba21d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0447200-91f8-44ac-a1c7-390c7ba21d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '897a36ed-4a13-493a-9546-8ce787d09944', 'volume_name': 'volume-897a36ed-4a13-493a-9546-8ce787d09944', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77467bac-d32a-4801-85df-21e1482ed09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77467bac-d32a-4801-85df-21e1482ed09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8cae55e-9125-4966-8c4c-a654d96e86e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:06 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Volume 897a36ed-4a13-493a-9546-8ce787d09944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-897a36ed-4a13-493a-9546-8ce787d09944', 'volume_size': 1} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-698031839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=897a36ed-4a13-493a-9546-8ce787d09944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9993774c8b5d480694dbfea5fcda625d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:06Z,use_quota=True,user_id='c5f607b502bd437490d8dea89b36fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Creating volume 897a36ed-4a13-493a-9546-8ce787d09944 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:24:06 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-897a36ed-4a13-493a-9546-8ce787d09944 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:06 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-897a36ed-4a13-493a-9546-8ce787d09944 1073741824 Sep 01 12:24:06 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:06 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e75aacda-8bf4-409a-b551-e780db93d2a2 Sep 01 12:24:06 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Flow 'volume_create_manager' (2e404299-1d81-4c3e-917c-f10ddfcca76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b32a19-b87a-4b1d-92b5-ae52f33e4a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b32a19-b87a-4b1d-92b5-ae52f33e4a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-564936692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd648123-f174-46cb-929c-0c5d9e8826c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9993774c8b5d480694dbfea5fcda625d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:07Z,use_quota=True,user_id='c5f607b502bd437490d8dea89b36fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213252b1-2a2e-45c3-88c3-292cb9c360a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213252b1-2a2e-45c3-88c3-292cb9c360a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29034811-6843-4342-bfc3-ebea5133b145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29034811-6843-4342-bfc3-ebea5133b145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd648123-f174-46cb-929c-0c5d9e8826c0', 'volume_name': 'volume-cd648123-f174-46cb-929c-0c5d9e8826c0', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59620d65-bac0-46e9-b306-475e27a8191a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59620d65-bac0-46e9-b306-475e27a8191a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62b01da-9c5c-4e78-9bf0-ab643814470c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:06 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Volume cd648123-f174-46cb-929c-0c5d9e8826c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd648123-f174-46cb-929c-0c5d9e8826c0', 'volume_size': 1} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:06 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-897a36ed-4a13-493a-9546-8ce787d09944 1073741824" returned: 0 in 0.697s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:06 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c50e8643-3311-40d0-ba32-230b532d518b tempest-VolumeDependencyTests-1858620102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e75aacda-8bf4-409a-b551-e780db93d2a2" returned: 0 in 0.798s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c50e8643-3311-40d0-ba32-230b532d518b tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e75aacda-8bf4-409a-b551-e780db93d2a2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:06 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e75aacda-8bf4-409a-b551-e780db93d2a2 Sep 01 12:24:06 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-897a36ed-4a13-493a-9546-8ce787d09944 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:07 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-897a36ed-4a13-493a-9546-8ce787d09944 Sep 01 12:24:07 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Flow 'volume_create_manager' (d64bc49d-5142-4946-8d74-781e05139717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f41e1f1-67d3-479b-af15-93b798047dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f41e1f1-67d3-479b-af15-93b798047dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-51942454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d004da9f-5d67-4cf2-a4fc-18ca7dc29e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9993774c8b5d480694dbfea5fcda625d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:07Z,use_quota=True,user_id='c5f607b502bd437490d8dea89b36fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214e60de-2fba-492d-8797-d9c28a7bce16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214e60de-2fba-492d-8797-d9c28a7bce16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34beb6e0-4eb3-4935-b962-6953c0025316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34beb6e0-4eb3-4935-b962-6953c0025316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd004da9f-5d67-4cf2-a4fc-18ca7dc29e54', 'volume_name': 'volume-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17db2b8-c274-48d2-85ae-a3606fee7ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17db2b8-c274-48d2-85ae-a3606fee7ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd61fd0f-c69c-49c9-af0f-53c53860e63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:07 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Volume d004da9f-5d67-4cf2-a4fc-18ca7dc29e54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54', 'volume_size': 1} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:07 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c50e8643-3311-40d0-ba32-230b532d518b tempest-VolumeDependencyTests-1858620102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-e75aacda-8bf4-409a-b551-e780db93d2a2" returned: 0 in 0.486s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c50e8643-3311-40d0-ba32-230b532d518b tempest-VolumeDependencyTests-1858620102 None] Lock "cinder-quobyte-e75aacda-8bf4-409a-b551-e780db93d2a2" released by "delete_volume" :: held 1.373s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:07 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-897a36ed-4a13-493a-9546-8ce787d09944" returned: 0 in 0.495s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.705s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-564936692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd648123-f174-46cb-929c-0c5d9e8826c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9993774c8b5d480694dbfea5fcda625d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:07Z,use_quota=True,user_id='c5f607b502bd437490d8dea89b36fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Creating volume cd648123-f174-46cb-929c-0c5d9e8826c0 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:24:07 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cd648123-f174-46cb-929c-0c5d9e8826c0 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:07 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cd648123-f174-46cb-929c-0c5d9e8826c0 1073741824 Sep 01 12:24:07 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8cae55e-9125-4966-8c4c-a654d96e86e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-897a36ed-4a13-493a-9546-8ce787d09944', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f662c9-96d0-4bdf-ae00-6851e21ee0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:07 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Volume volume-897a36ed-4a13-493a-9546-8ce787d09944 (897a36ed-4a13-493a-9546-8ce787d09944): created successfully Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f662c9-96d0-4bdf-ae00-6851e21ee0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Flow 'volume_create_manager' (e2e3a5c6-c5c9-4414-b3e6-33aeba3a12c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:07 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2840a6d3-d74b-49ab-b9ca-0a6af8680914 tempest-CreateVolumesFromSnapshotTest-51667841 None] Created volume successfully. Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Flow 'volume_create_manager' (0189346b-15d8-4edc-bc88-8563a660a6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33375d7c-ef05-4fb7-893c-380a0f44024a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c50e8643-3311-40d0-ba32-230b532d518b tempest-VolumeDependencyTests-1858620102 None] Created reservations ['61c13577-42b9-455b-aa4b-26fba0a19434', '3d29d02e-48e5-4560-a722-1d4d6704fa6e', '0d66ba51-157b-4e83-8f3a-8dba2f389c39', '8c19c2fc-bb3d-4170-905f-96079a0420a9'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33375d7c-ef05-4fb7-893c-380a0f44024a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1343528606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09aae17-c62d-4a8d-aac9-ec5994e2315f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9993774c8b5d480694dbfea5fcda625d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:08Z,use_quota=True,user_id='c5f607b502bd437490d8dea89b36fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a26061b-6577-48c0-a05c-1713672c0fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a26061b-6577-48c0-a05c-1713672c0fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2db91d-edb9-4fad-99cd-4d1c7822f8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2db91d-edb9-4fad-99cd-4d1c7822f8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f09aae17-c62d-4a8d-aac9-ec5994e2315f', 'volume_name': 'volume-f09aae17-c62d-4a8d-aac9-ec5994e2315f', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a289c1-cf99-4a1b-a0f8-cb1968093c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a289c1-cf99-4a1b-a0f8-cb1968093c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63358065-3ded-4e79-8b83-2e1c7cadbd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:07 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Volume f09aae17-c62d-4a8d-aac9-ec5994e2315f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f09aae17-c62d-4a8d-aac9-ec5994e2315f', 'volume_size': 1} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c50e8643-3311-40d0-ba32-230b532d518b tempest-VolumeDependencyTests-1858620102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c50e8643-3311-40d0-ba32-230b532d518b tempest-VolumeDependencyTests-1858620102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c50e8643-3311-40d0-ba32-230b532d518b tempest-VolumeDependencyTests-1858620102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c50e8643-3311-40d0-ba32-230b532d518b tempest-VolumeDependencyTests-1858620102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c50e8643-3311-40d0-ba32-230b532d518b tempest-VolumeDependencyTests-1858620102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c50e8643-3311-40d0-ba32-230b532d518b tempest-VolumeDependencyTests-1858620102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:08 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:08 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:08 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cd648123-f174-46cb-929c-0c5d9e8826c0 1073741824" returned: 0 in 0.655s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cd648123-f174-46cb-929c-0c5d9e8826c0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:08 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cd648123-f174-46cb-929c-0c5d9e8826c0 Sep 01 12:24:08 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:24:08 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Flow 'volume_create_manager' (4e9ad057-17cd-4b29-951c-ba6c044fb170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c43ed0-16d3-40d2-8ecd-49982244cb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c50e8643-3311-40d0-ba32-230b532d518b tempest-VolumeDependencyTests-1858620102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.427s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c50e8643-3311-40d0-ba32-230b532d518b tempest-VolumeDependencyTests-1858620102 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:08 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c50e8643-3311-40d0-ba32-230b532d518b tempest-VolumeDependencyTests-1858620102 None] Deleted volume successfully. Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c43ed0-16d3-40d2-8ecd-49982244cb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1186481414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e74e9f5-e481-45f5-b909-8a3000d9da85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9993774c8b5d480694dbfea5fcda625d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:08Z,use_quota=True,user_id='c5f607b502bd437490d8dea89b36fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f539ab38-a772-44ce-af9d-7fd489ccc626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f539ab38-a772-44ce-af9d-7fd489ccc626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb1172a-a413-445f-ae2a-77b1a8d2bdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb1172a-a413-445f-ae2a-77b1a8d2bdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e74e9f5-e481-45f5-b909-8a3000d9da85', 'volume_name': 'volume-6e74e9f5-e481-45f5-b909-8a3000d9da85', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c98fc261-743e-4d04-a493-d6f4e6285e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c98fc261-743e-4d04-a493-d6f4e6285e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab62a37-56f3-4998-a05c-94a7586d733a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:08 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Volume 6e74e9f5-e481-45f5-b909-8a3000d9da85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e74e9f5-e481-45f5-b909-8a3000d9da85', 'volume_size': 1} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c50e8643-3311-40d0-ba32-230b532d518b tempest-VolumeDependencyTests-1858620102 None] Lock "cinder-e75aacda-8bf4-409a-b551-e780db93d2a2-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cd648123-f174-46cb-929c-0c5d9e8826c0" returned: 0 in 0.338s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:24:08 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.237s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-51942454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d004da9f-5d67-4cf2-a4fc-18ca7dc29e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9993774c8b5d480694dbfea5fcda625d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:07Z,use_quota=True,user_id='c5f607b502bd437490d8dea89b36fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Creating volume d004da9f-5d67-4cf2-a4fc-18ca7dc29e54 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:24:08 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:08 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54 1073741824 Sep 01 12:24:08 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62b01da-9c5c-4e78-9bf0-ab643814470c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd648123-f174-46cb-929c-0c5d9e8826c0', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf08a170-43e2-4254-96e5-2b0f0e477f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:08 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Volume volume-cd648123-f174-46cb-929c-0c5d9e8826c0 (cd648123-f174-46cb-929c-0c5d9e8826c0): created successfully Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf08a170-43e2-4254-96e5-2b0f0e477f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Flow 'volume_create_manager' (2e404299-1d81-4c3e-917c-f10ddfcca76e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:08 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-249f3cde-5ffc-47cb-b4ea-5ae67ecbc7fe tempest-CreateVolumesFromSnapshotTest-51667841 None] Created volume successfully. Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Flow 'volume_create_manager' (d195c29a-8170-41ed-83ea-ddb69b672203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (393fec0f-8adc-4b3e-bd44-a7de5eef7000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (393fec0f-8adc-4b3e-bd44-a7de5eef7000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1187044027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08158d81-3054-46af-8d59-bdca4ec97bb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f303c21f6004c3b8f3683085fa69682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:09Z,use_quota=True,user_id='6630d9cae50f4034a07faed651147f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3729898-a947-4736-a862-bc497ccf8ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3729898-a947-4736-a862-bc497ccf8ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f6a284-9ddc-4bce-ab97-89f14bf7e0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f6a284-9ddc-4bce-ab97-89f14bf7e0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08158d81-3054-46af-8d59-bdca4ec97bb0', 'volume_name': 'volume-08158d81-3054-46af-8d59-bdca4ec97bb0', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e829219d-3eb5-47ca-b83b-c3da964c8887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e829219d-3eb5-47ca-b83b-c3da964c8887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6612698-e760-453d-aa09-b6fdc7a365e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:08 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Volume 08158d81-3054-46af-8d59-bdca4ec97bb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08158d81-3054-46af-8d59-bdca4ec97bb0', 'volume_size': 1} Sep 01 12:24:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:09 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54 1073741824" returned: 0 in 0.541s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:09 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54 Sep 01 12:24:09 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:09 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54" returned: 0 in 0.354s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:24:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.675s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1343528606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09aae17-c62d-4a8d-aac9-ec5994e2315f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9993774c8b5d480694dbfea5fcda625d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:08Z,use_quota=True,user_id='c5f607b502bd437490d8dea89b36fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:24:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Creating volume f09aae17-c62d-4a8d-aac9-ec5994e2315f {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:24:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:24:09 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:24:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f09aae17-c62d-4a8d-aac9-ec5994e2315f 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:09 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f09aae17-c62d-4a8d-aac9-ec5994e2315f 1073741824 Sep 01 12:24:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd61fd0f-c69c-49c9-af0f-53c53860e63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:09 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5661ca54-e6ed-4622-89b7-1d492e1364d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:09 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Volume volume-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54 (d004da9f-5d67-4cf2-a4fc-18ca7dc29e54): created successfully Sep 01 12:24:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5661ca54-e6ed-4622-89b7-1d492e1364d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:09 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Flow 'volume_create_manager' (d64bc49d-5142-4946-8d74-781e05139717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:09 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d0a41688-d51e-4f96-82e5-21c92057d28d tempest-CreateVolumesFromSnapshotTest-51667841 None] Created volume successfully. Sep 01 12:24:10 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f09aae17-c62d-4a8d-aac9-ec5994e2315f 1073741824" returned: 0 in 0.590s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f09aae17-c62d-4a8d-aac9-ec5994e2315f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:10 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f09aae17-c62d-4a8d-aac9-ec5994e2315f Sep 01 12:24:10 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:10 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f09aae17-c62d-4a8d-aac9-ec5994e2315f" returned: 0 in 0.273s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:24:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.958s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1186481414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e74e9f5-e481-45f5-b909-8a3000d9da85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9993774c8b5d480694dbfea5fcda625d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:08Z,use_quota=True,user_id='c5f607b502bd437490d8dea89b36fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:24:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Creating volume 6e74e9f5-e481-45f5-b909-8a3000d9da85 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:24:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:10 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:24:10 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:24:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6e74e9f5-e481-45f5-b909-8a3000d9da85 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63358065-3ded-4e79-8b83-2e1c7cadbd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f09aae17-c62d-4a8d-aac9-ec5994e2315f', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9249a5a0-c5b1-4697-81c2-d9ff950bc20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:10 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6e74e9f5-e481-45f5-b909-8a3000d9da85 1073741824 Sep 01 12:24:10 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:10 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Volume volume-f09aae17-c62d-4a8d-aac9-ec5994e2315f (f09aae17-c62d-4a8d-aac9-ec5994e2315f): created successfully Sep 01 12:24:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9249a5a0-c5b1-4697-81c2-d9ff950bc20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:10 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Flow 'volume_create_manager' (0189346b-15d8-4edc-bc88-8563a660a6a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:10 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4278d60a-c20d-4be8-936a-1270ea3a3e15 tempest-CreateVolumesFromSnapshotTest-51667841 None] Created volume successfully. Sep 01 12:24:11 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6e74e9f5-e481-45f5-b909-8a3000d9da85 1073741824" returned: 0 in 0.552s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6e74e9f5-e481-45f5-b909-8a3000d9da85 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:11 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6e74e9f5-e481-45f5-b909-8a3000d9da85 Sep 01 12:24:11 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:11 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6e74e9f5-e481-45f5-b909-8a3000d9da85" returned: 0 in 0.303s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.423s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1187044027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08158d81-3054-46af-8d59-bdca4ec97bb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f303c21f6004c3b8f3683085fa69682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:09Z,use_quota=True,user_id='6630d9cae50f4034a07faed651147f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Creating volume 08158d81-3054-46af-8d59-bdca4ec97bb0 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:24:11 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:24:11 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0 1073741824 Sep 01 12:24:11 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Flow 'volume_create_manager' (685da221-18f6-4505-88f3-98e0583914ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1494f2b-3770-4346-a80f-d8a7b4e9901a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab62a37-56f3-4998-a05c-94a7586d733a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e74e9f5-e481-45f5-b909-8a3000d9da85', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc74853-10ac-4cd3-afca-f169c75901a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1494f2b-3770-4346-a80f-d8a7b4e9901a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1425460-7636-4981-8859-7b291896a489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd1a52d3e4f42bc81beb7586d30d4b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:11Z,use_quota=True,user_id='18360b462acc4c5e85adfc846dc091ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54711f8c-7756-42b0-a572-907c08c368e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54711f8c-7756-42b0-a572-907c08c368e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b9eb07-883b-46eb-b368-c8294353e763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.image.glance [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Creating Keystone auth plugin from conf {{(pid=87084) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 12:24:11 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Volume volume-6e74e9f5-e481-45f5-b909-8a3000d9da85 (6e74e9f5-e481-45f5-b909-8a3000d9da85): created successfully Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc74853-10ac-4cd3-afca-f169c75901a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Flow 'volume_create_manager' (4e9ad057-17cd-4b29-951c-ba6c044fb170) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:11 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e16fc8e6-010f-4b72-bbd3-573a57271d47 tempest-CreateVolumesFromSnapshotTest-51667841 None] Created volume successfully. Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6e78d9e0-7741-490d-8994-88bc9f2c0301 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "cinder-6e74e9f5-e481-45f5-b909-8a3000d9da85-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6e78d9e0-7741-490d-8994-88bc9f2c0301 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-6e74e9f5-e481-45f5-b909-8a3000d9da85-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6e78d9e0-7741-490d-8994-88bc9f2c0301 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "cinder-quobyte-6e74e9f5-e481-45f5-b909-8a3000d9da85" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6e78d9e0-7741-490d-8994-88bc9f2c0301 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-quobyte-6e74e9f5-e481-45f5-b909-8a3000d9da85" acquired by "delete_volume" :: waited 0.040s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[12943655-0633-4ffc-862e-aec60b840bb1]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6e78d9e0-7741-490d-8994-88bc9f2c0301 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6e74e9f5-e481-45f5-b909-8a3000d9da85 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b9eb07-883b-46eb-b368-c8294353e763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a1425460-7636-4981-8859-7b291896a489', 'volume_name': 'volume-a1425460-7636-4981-8859-7b291896a489', 'volume_size': 1, 'image_id': '09567158-3a03-4db5-9721-7a6f9521ff59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09567158-3a03-4db5-9721-7a6f9521ff59', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cee978e9a76257129d8e87f3643cd940', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1bd1a52d3e4f42bc81beb7586d30d4b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bf21bf75396cb0484dbce70c2bdbfc3f21ab87d9c0102af5ae6ff009886a0efb7d1d71bf5a79a43f7c4ee83b8b714cc74ac98c4531d6b3680cb2cd95bbb8ea23', 'id': '09567158-3a03-4db5-9721-7a6f9521ff59', 'created_at': datetime.datetime(2026, 9, 1, 10, 24, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 24, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09567158-3a03-4db5-9721-7a6f9521ff59/file', 'properties': {}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:12 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47a1af9-2ec2-4253-a4d8-fd6d3456db98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:12 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6e74e9f5-e481-45f5-b909-8a3000d9da85 Sep 01 12:24:12 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47a1af9-2ec2-4253-a4d8-fd6d3456db98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9bc7d30-6a75-4e33-9486-61d0085d2c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:12 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Volume a1425460-7636-4981-8859-7b291896a489: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a1425460-7636-4981-8859-7b291896a489', 'volume_size': 1, 'image_id': '09567158-3a03-4db5-9721-7a6f9521ff59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09567158-3a03-4db5-9721-7a6f9521ff59', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cee978e9a76257129d8e87f3643cd940', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1bd1a52d3e4f42bc81beb7586d30d4b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bf21bf75396cb0484dbce70c2bdbfc3f21ab87d9c0102af5ae6ff009886a0efb7d1d71bf5a79a43f7c4ee83b8b714cc74ac98c4531d6b3680cb2cd95bbb8ea23', 'id': '09567158-3a03-4db5-9721-7a6f9521ff59', 'created_at': datetime.datetime(2026, 9, 1, 10, 24, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 24, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09567158-3a03-4db5-9721-7a6f9521ff59/file', 'properties': {}}, 'image_service': } Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Trying to clone a1425460-7636-4981-8859-7b291896a489 from image 09567158-3a03-4db5-9721-7a6f9521ff59 at location (None, [{'url': 'file:///opt/stack/data/glance/images/09567158-3a03-4db5-9721-7a6f9521ff59', 'metadata': {}}]). {{(pid=87084) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0 1073741824" returned: 0 in 0.690s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Flow 'volume_create_manager' (518db486-3aff-4ff1-9ae6-d418c0aba1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:12 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0 Sep 01 12:24:12 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c83f66-0dee-4acf-a93d-caedef8b5ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 12:24:12 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Image download 0.00 MB at 0.00 MB/s Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c83f66-0dee-4acf-a93d-caedef8b5ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e7effc-347f-47b6-b567-472750f4e0e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b7894f22654a97befd33dcac833688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:12Z,use_quota=True,user_id='45f7666933d54540a5b40b88738e4618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b008d0c5-e755-48b3-bbbb-b188ecacd55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b008d0c5-e755-48b3-bbbb-b188ecacd55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641791cb-d753-4f25-91d4-3c59165cf17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641791cb-d753-4f25-91d4-3c59165cf17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7e7effc-347f-47b6-b567-472750f4e0e6', 'volume_name': 'volume-a7e7effc-347f-47b6-b567-472750f4e0e6', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1051121-1783-416c-9e86-f7661e216616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1051121-1783-416c-9e86-f7661e216616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140619ad-961d-4aec-a8d5-3f7d77696421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:12 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Volume a7e7effc-347f-47b6-b567-472750f4e0e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7e7effc-347f-47b6-b567-472750f4e0e6', 'volume_size': 1} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4c326e-87d0-4bdc-a46c-1a6f50046626]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:12 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6e78d9e0-7741-490d-8994-88bc9f2c0301 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6e74e9f5-e481-45f5-b909-8a3000d9da85" returned: 0 in 0.412s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6e78d9e0-7741-490d-8994-88bc9f2c0301 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6e74e9f5-e481-45f5-b909-8a3000d9da85 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:12 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6e74e9f5-e481-45f5-b909-8a3000d9da85 Sep 01 12:24:12 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:12 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD Sep 01 12:24:12 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:12 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0" returned: 0 in 0.303s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.199s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e7effc-347f-47b6-b567-472750f4e0e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b7894f22654a97befd33dcac833688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:12Z,use_quota=True,user_id='45f7666933d54540a5b40b88738e4618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Creating volume a7e7effc-347f-47b6-b567-472750f4e0e6 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:24:12 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a7e7effc-347f-47b6-b567-472750f4e0e6 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6612698-e760-453d-aa09-b6fdc7a365e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08158d81-3054-46af-8d59-bdca4ec97bb0', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe945b4b-10db-4d49-bf86-585a25fe56ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:12 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a7e7effc-347f-47b6-b567-472750f4e0e6 1073741824 Sep 01 12:24:12 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:12 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Volume volume-08158d81-3054-46af-8d59-bdca4ec97bb0 (08158d81-3054-46af-8d59-bdca4ec97bb0): created successfully Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe945b4b-10db-4d49-bf86-585a25fe56ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Flow 'volume_create_manager' (d195c29a-8170-41ed-83ea-ddb69b672203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:12 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-88063855-6f81-4a87-ba37-cdadc0a94a26 tempest-ProjectMemberTests-1072060943 None] Created volume successfully. Sep 01 12:24:12 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6e78d9e0-7741-490d-8994-88bc9f2c0301 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-6e74e9f5-e481-45f5-b909-8a3000d9da85" returned: 0 in 0.261s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6e78d9e0-7741-490d-8994-88bc9f2c0301 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-quobyte-6e74e9f5-e481-45f5-b909-8a3000d9da85" released by "delete_volume" :: held 0.763s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:12 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-6e78d9e0-7741-490d-8994-88bc9f2c0301 tempest-CreateVolumesFromSnapshotTest-51667841 None] Created reservations ['51eb62b9-0dec-46ba-87e5-9da4f760e4d4', 'c2e8ce11-752b-4fba-aafe-9b0dc19dac42', 'b96361c1-ade9-45e2-9a29-3ee005f91fb7', '48fc3825-6e8d-4195-999c-10db9ecb0ba5'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6e78d9e0-7741-490d-8994-88bc9f2c0301 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6e78d9e0-7741-490d-8994-88bc9f2c0301 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6e78d9e0-7741-490d-8994-88bc9f2c0301 tempest-CreateVolumesFromSnapshotTest-51667841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-6e78d9e0-7741-490d-8994-88bc9f2c0301 tempest-CreateVolumesFromSnapshotTest-51667841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-6e78d9e0-7741-490d-8994-88bc9f2c0301 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6e78d9e0-7741-490d-8994-88bc9f2c0301 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:12 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD Sep 01 12:24:12 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:12 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:12 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:12 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e1a5f9ed-9eb2-43cd-8db6-e5a9a50d7dc2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "cinder-f09aae17-c62d-4a8d-aac9-ec5994e2315f-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e1a5f9ed-9eb2-43cd-8db6-e5a9a50d7dc2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-f09aae17-c62d-4a8d-aac9-ec5994e2315f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:13 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a7e7effc-347f-47b6-b567-472750f4e0e6 1073741824" returned: 0 in 0.580s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e1a5f9ed-9eb2-43cd-8db6-e5a9a50d7dc2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "cinder-quobyte-f09aae17-c62d-4a8d-aac9-ec5994e2315f" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:13 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD" returned: 1 in 0.436s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Temporary image 09567158-3a03-4db5-9721-7a6f9521ff59 is fetched for user 18360b462acc4c5e85adfc846dc091ec. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e1a5f9ed-9eb2-43cd-8db6-e5a9a50d7dc2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-quobyte-f09aae17-c62d-4a8d-aac9-ec5994e2315f" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:13 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a7e7effc-347f-47b6-b567-472750f4e0e6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-6e78d9e0-7741-490d-8994-88bc9f2c0301 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.367s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-6e78d9e0-7741-490d-8994-88bc9f2c0301 tempest-CreateVolumesFromSnapshotTest-51667841 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a4268b-84a3-42ef-a393-45b12f9030c4]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e1a5f9ed-9eb2-43cd-8db6-e5a9a50d7dc2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f09aae17-c62d-4a8d-aac9-ec5994e2315f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:13 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a7e7effc-347f-47b6-b567-472750f4e0e6 Sep 01 12:24:13 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:13 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-6e78d9e0-7741-490d-8994-88bc9f2c0301 tempest-CreateVolumesFromSnapshotTest-51667841 None] Deleted volume successfully. Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-6e78d9e0-7741-490d-8994-88bc9f2c0301 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-6e74e9f5-e481-45f5-b909-8a3000d9da85-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a337810-cab8-4003-ab58-9f1022500c30]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:13 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f09aae17-c62d-4a8d-aac9-ec5994e2315f Sep 01 12:24:13 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:13 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD Sep 01 12:24:13 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:13 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a7e7effc-347f-47b6-b567-472750f4e0e6" returned: 0 in 0.359s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140619ad-961d-4aec-a8d5-3f7d77696421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7e7effc-347f-47b6-b567-472750f4e0e6', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abe87ff4-b7b7-48cf-a632-9d6f7ecc93fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:13 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Volume volume-a7e7effc-347f-47b6-b567-472750f4e0e6 (a7e7effc-347f-47b6-b567-472750f4e0e6): created successfully Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abe87ff4-b7b7-48cf-a632-9d6f7ecc93fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Flow 'volume_create_manager' (518db486-3aff-4ff1-9ae6-d418c0aba1e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:13 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-d45edb16-9602-4a58-b926-45a373951127 tempest-CinderUnicodeTest-1098367274 None] Created volume successfully. Sep 01 12:24:13 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e1a5f9ed-9eb2-43cd-8db6-e5a9a50d7dc2 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f09aae17-c62d-4a8d-aac9-ec5994e2315f" returned: 0 in 0.462s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e1a5f9ed-9eb2-43cd-8db6-e5a9a50d7dc2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f09aae17-c62d-4a8d-aac9-ec5994e2315f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8d36b5dd-fbd7-4881-b329-dee8cd052d0d tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8d36b5dd-fbd7-4881-b329-dee8cd052d0d tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:13 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:13 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f09aae17-c62d-4a8d-aac9-ec5994e2315f Sep 01 12:24:13 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-8d36b5dd-fbd7-4881-b329-dee8cd052d0d tempest-ProjectMemberTests-1072060943 None] Creating offline snapshot 9d18e82a-f1d7-4ede-8572-09e36dfc4bd2 of volume 08158d81-3054-46af-8d59-bdca4ec97bb0 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[465c8f46-383d-4b55-8b78-7eea85718065]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d36b5dd-fbd7-4881-b329-dee8cd052d0d tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:13 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD Sep 01 12:24:13 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:13 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0 Sep 01 12:24:13 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:13 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e1a5f9ed-9eb2-43cd-8db6-e5a9a50d7dc2 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f09aae17-c62d-4a8d-aac9-ec5994e2315f" returned: 0 in 0.280s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e1a5f9ed-9eb2-43cd-8db6-e5a9a50d7dc2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-quobyte-f09aae17-c62d-4a8d-aac9-ec5994e2315f" released by "delete_volume" :: held 0.812s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:13 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-e1a5f9ed-9eb2-43cd-8db6-e5a9a50d7dc2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Created reservations ['a04dd43a-feaf-4733-a5a4-e1b782211557', 'fac46b86-b4bc-447c-9e47-69bddfca5ce9', '3e98521b-88ca-47ca-af6c-8ed53936b69b', '6be2d9f1-0a92-450a-9109-23a8349682f9'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:14 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD" returned: 1 in 0.356s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e1a5f9ed-9eb2-43cd-8db6-e5a9a50d7dc2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e1a5f9ed-9eb2-43cd-8db6-e5a9a50d7dc2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e1a5f9ed-9eb2-43cd-8db6-e5a9a50d7dc2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e1a5f9ed-9eb2-43cd-8db6-e5a9a50d7dc2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e1a5f9ed-9eb2-43cd-8db6-e5a9a50d7dc2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e1a5f9ed-9eb2-43cd-8db6-e5a9a50d7dc2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:14 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d36b5dd-fbd7-4881-b329-dee8cd052d0d tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0" returned: 0 in 0.375s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d36b5dd-fbd7-4881-b329-dee8cd052d0d tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.9d18e82a-f1d7-4ede-8572-09e36dfc4bd2 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:14 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:14 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:14 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.9d18e82a-f1d7-4ede-8572-09e36dfc4bd2 1G Sep 01 12:24:14 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0e3b75a5-d93c-43ab-acab-8606d79c1ef2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "cinder-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0e3b75a5-d93c-43ab-acab-8606d79c1ef2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0e3b75a5-d93c-43ab-acab-8606d79c1ef2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "cinder-quobyte-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0e3b75a5-d93c-43ab-acab-8606d79c1ef2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-quobyte-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4155b530-4541-436c-af91-2fa78afcdaed]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0e3b75a5-d93c-43ab-acab-8606d79c1ef2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:14 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e1a5f9ed-9eb2-43cd-8db6-e5a9a50d7dc2 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.307s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-e1a5f9ed-9eb2-43cd-8db6-e5a9a50d7dc2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:14 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e1a5f9ed-9eb2-43cd-8db6-e5a9a50d7dc2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Deleted volume successfully. Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e1a5f9ed-9eb2-43cd-8db6-e5a9a50d7dc2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-f09aae17-c62d-4a8d-aac9-ec5994e2315f-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:14 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54 Sep 01 12:24:14 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:14 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d36b5dd-fbd7-4881-b329-dee8cd052d0d tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.9d18e82a-f1d7-4ede-8572-09e36dfc4bd2 1G" returned: 0 in 0.473s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d36b5dd-fbd7-4881-b329-dee8cd052d0d tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08158d81-3054-46af-8d59-bdca4ec97bb0 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.9d18e82a-f1d7-4ede-8572-09e36dfc4bd2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:14 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08158d81-3054-46af-8d59-bdca4ec97bb0 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.9d18e82a-f1d7-4ede-8572-09e36dfc4bd2 Sep 01 12:24:14 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:14 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0e3b75a5-d93c-43ab-acab-8606d79c1ef2 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54" returned: 0 in 0.436s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0e3b75a5-d93c-43ab-acab-8606d79c1ef2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:14 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54 Sep 01 12:24:14 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:14 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d36b5dd-fbd7-4881-b329-dee8cd052d0d tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08158d81-3054-46af-8d59-bdca4ec97bb0 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.9d18e82a-f1d7-4ede-8572-09e36dfc4bd2" returned: 0 in 0.375s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:14 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-8d36b5dd-fbd7-4881-b329-dee8cd052d0d tempest-ProjectMemberTests-1072060943 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.9d18e82a-f1d7-4ede-8572-09e36dfc4bd2 is being set with open permissions: ugo+rw Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d36b5dd-fbd7-4881-b329-dee8cd052d0d tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.9d18e82a-f1d7-4ede-8572-09e36dfc4bd2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:14 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.9d18e82a-f1d7-4ede-8572-09e36dfc4bd2 Sep 01 12:24:14 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:24:14 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Flow 'volume_create_manager' (f4a18de4-05d4-4e0b-af7f-cc80e7704a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ab7b81-5916-42d2-a0fc-a7db7c4c150c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ab7b81-5916-42d2-a0fc-a7db7c4c150c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-810029854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=436c3b5b-921b-4ddc-90aa-ef16fde77e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b7894f22654a97befd33dcac833688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:15Z,use_quota=True,user_id='45f7666933d54540a5b40b88738e4618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20f40ef-6605-445f-8025-1a927177d1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:15 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20f40ef-6605-445f-8025-1a927177d1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb92c5f9-c638-4a47-8828-7a24432743df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb92c5f9-c638-4a47-8828-7a24432743df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '436c3b5b-921b-4ddc-90aa-ef16fde77e5b', 'volume_name': 'volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf0a9a1-7b72-48f1-9901-fd5590591691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf0a9a1-7b72-48f1-9901-fd5590591691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df013c5-bbcc-421e-a457-2a76664adab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:15 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Volume 436c3b5b-921b-4ddc-90aa-ef16fde77e5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b', 'volume_size': 1} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0e3b75a5-d93c-43ab-acab-8606d79c1ef2 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54" returned: 0 in 0.298s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0e3b75a5-d93c-43ab-acab-8606d79c1ef2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-quobyte-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54" released by "delete_volume" :: held 0.788s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-0e3b75a5-d93c-43ab-acab-8606d79c1ef2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Created reservations ['e8b4c1d8-5fb7-4395-b713-d9f6f885ccb5', '65b6dcd0-4a08-4a83-b74c-07b635db522b', '2e91ae65-5ebd-4218-8c9f-ae7bcfcb94fb', '6bb72bf9-789d-477f-8f84-797b21ba6250'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0e3b75a5-d93c-43ab-acab-8606d79c1ef2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0e3b75a5-d93c-43ab-acab-8606d79c1ef2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0e3b75a5-d93c-43ab-acab-8606d79c1ef2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0e3b75a5-d93c-43ab-acab-8606d79c1ef2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0e3b75a5-d93c-43ab-acab-8606d79c1ef2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0e3b75a5-d93c-43ab-acab-8606d79c1ef2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:15 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:15 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:15 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d36b5dd-fbd7-4881-b329-dee8cd052d0d tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.9d18e82a-f1d7-4ede-8572-09e36dfc4bd2" returned: 0 in 0.293s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d36b5dd-fbd7-4881-b329-dee8cd052d0d tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:15 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.info Sep 01 12:24:15 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-80df759a-921e-489b-8bb6-c38b01d162fc tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "cinder-cd648123-f174-46cb-929c-0c5d9e8826c0-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-80df759a-921e-489b-8bb6-c38b01d162fc tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-cd648123-f174-46cb-929c-0c5d9e8826c0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-80df759a-921e-489b-8bb6-c38b01d162fc tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "cinder-quobyte-cd648123-f174-46cb-929c-0c5d9e8826c0" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-80df759a-921e-489b-8bb6-c38b01d162fc tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-quobyte-cd648123-f174-46cb-929c-0c5d9e8826c0" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:15 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0e3b75a5-d93c-43ab-acab-8606d79c1ef2 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.322s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-0e3b75a5-d93c-43ab-acab-8606d79c1ef2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:15 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0e3b75a5-d93c-43ab-acab-8606d79c1ef2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Deleted volume successfully. Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbd30ec-8912-4479-ac2d-fd456de49ab8]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-80df759a-921e-489b-8bb6-c38b01d162fc tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cd648123-f174-46cb-929c-0c5d9e8826c0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0e3b75a5-d93c-43ab-acab-8606d79c1ef2 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-d004da9f-5d67-4cf2-a4fc-18ca7dc29e54-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:15 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d36b5dd-fbd7-4881-b329-dee8cd052d0d tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.info" returned: 0 in 0.381s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:15 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-8d36b5dd-fbd7-4881-b329-dee8cd052d0d tempest-ProjectMemberTests-1072060943 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.info is being set with open permissions: ugo+rw Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d36b5dd-fbd7-4881-b329-dee8cd052d0d tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:15 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cd648123-f174-46cb-929c-0c5d9e8826c0 Sep 01 12:24:15 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:15 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.info Sep 01 12:24:15 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:15 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8d36b5dd-fbd7-4881-b329-dee8cd052d0d tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.info" returned: 0 in 0.293s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:15 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-8d36b5dd-fbd7-4881-b329-dee8cd052d0d tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.304s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.937s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1425460-7636-4981-8859-7b291896a489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd1a52d3e4f42bc81beb7586d30d4b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:11Z,use_quota=True,user_id='18360b462acc4c5e85adfc846dc091ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Creating volume a1425460-7636-4981-8859-7b291896a489 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:24:15 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a1425460-7636-4981-8859-7b291896a489 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-80df759a-921e-489b-8bb6-c38b01d162fc tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cd648123-f174-46cb-929c-0c5d9e8826c0" returned: 0 in 0.444s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-80df759a-921e-489b-8bb6-c38b01d162fc tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cd648123-f174-46cb-929c-0c5d9e8826c0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:16 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a1425460-7636-4981-8859-7b291896a489 1073741824 Sep 01 12:24:16 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:16 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cd648123-f174-46cb-929c-0c5d9e8826c0 Sep 01 12:24:16 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:16 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8d36b5dd-fbd7-4881-b329-dee8cd052d0d tempest-ProjectMemberTests-1072060943 None] Create snapshot completed successfully Sep 01 12:24:16 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-80df759a-921e-489b-8bb6-c38b01d162fc tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-cd648123-f174-46cb-929c-0c5d9e8826c0" returned: 0 in 0.248s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-80df759a-921e-489b-8bb6-c38b01d162fc tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-quobyte-cd648123-f174-46cb-929c-0c5d9e8826c0" released by "delete_volume" :: held 0.760s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-80df759a-921e-489b-8bb6-c38b01d162fc tempest-CreateVolumesFromSnapshotTest-51667841 None] Created reservations ['8fb6cc4c-d116-4def-bad0-14d53276051e', 'c7a46487-3595-420b-a3ce-35fa9ce56c27', '297ac4ff-c081-4129-82cc-002b25582645', 'c0cdc02d-3233-4f81-aef8-be97e69aa672'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-80df759a-921e-489b-8bb6-c38b01d162fc tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-80df759a-921e-489b-8bb6-c38b01d162fc tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-80df759a-921e-489b-8bb6-c38b01d162fc tempest-CreateVolumesFromSnapshotTest-51667841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-80df759a-921e-489b-8bb6-c38b01d162fc tempest-CreateVolumesFromSnapshotTest-51667841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-80df759a-921e-489b-8bb6-c38b01d162fc tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-80df759a-921e-489b-8bb6-c38b01d162fc tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:16 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:16 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:16 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a1425460-7636-4981-8859-7b291896a489 1073741824" returned: 0 in 0.442s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a1425460-7636-4981-8859-7b291896a489 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:16 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a1425460-7636-4981-8859-7b291896a489 Sep 01 12:24:16 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2577ea7b-ce34-4e00-a15c-1eba8472c462 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "cinder-897a36ed-4a13-493a-9546-8ce787d09944-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2577ea7b-ce34-4e00-a15c-1eba8472c462 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-897a36ed-4a13-493a-9546-8ce787d09944-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:16 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-80df759a-921e-489b-8bb6-c38b01d162fc tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.297s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-80df759a-921e-489b-8bb6-c38b01d162fc tempest-CreateVolumesFromSnapshotTest-51667841 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2577ea7b-ce34-4e00-a15c-1eba8472c462 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "cinder-quobyte-897a36ed-4a13-493a-9546-8ce787d09944" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:16 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-80df759a-921e-489b-8bb6-c38b01d162fc tempest-CreateVolumesFromSnapshotTest-51667841 None] Deleted volume successfully. Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2577ea7b-ce34-4e00-a15c-1eba8472c462 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-quobyte-897a36ed-4a13-493a-9546-8ce787d09944" acquired by "delete_volume" :: waited 0.041s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-80df759a-921e-489b-8bb6-c38b01d162fc tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-cd648123-f174-46cb-929c-0c5d9e8826c0-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c2e511-5113-4bfe-9661-89e00078a306]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2577ea7b-ce34-4e00-a15c-1eba8472c462 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-897a36ed-4a13-493a-9546-8ce787d09944 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:16 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a1425460-7636-4981-8859-7b291896a489" returned: 0 in 0.376s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.782s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-810029854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=436c3b5b-921b-4ddc-90aa-ef16fde77e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b7894f22654a97befd33dcac833688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:15Z,use_quota=True,user_id='45f7666933d54540a5b40b88738e4618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Creating volume 436c3b5b-921b-4ddc-90aa-ef16fde77e5b {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:24:16 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-9d18e82a-f1d7-4ede-8572-09e36dfc4bd2-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:16 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b 1073741824 Sep 01 12:24:16 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-9d18e82a-f1d7-4ede-8572-09e36dfc4bd2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-08158d81-3054-46af-8d59-bdca4ec97bb0" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Attempting download of 09567158-3a03-4db5-9721-7a6f9521ff59 ((None, [{'url': 'file:///opt/stack/data/glance/images/09567158-3a03-4db5-9721-7a6f9521ff59', 'metadata': {}}])) to volume a1425460-7636-4981-8859-7b291896a489. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 12:24:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-08158d81-3054-46af-8d59-bdca4ec97bb0" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-9d18e82a-f1d7-4ede-8572-09e36dfc4bd2" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:17 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-897a36ed-4a13-493a-9546-8ce787d09944 Sep 01 12:24:17 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-9d18e82a-f1d7-4ede-8572-09e36dfc4bd2" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] Deleting offline snapshot 9d18e82a-f1d7-4ede-8572-09e36dfc4bd2 of volume 08158d81-3054-46af-8d59-bdca4ec97bb0 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] snapshot_file for this snap is: volume-08158d81-3054-46af-8d59-bdca4ec97bb0.9d18e82a-f1d7-4ede-8572-09e36dfc4bd2 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[019f0494-75fc-4f8f-91d8-b046daf0e358]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.9d18e82a-f1d7-4ede-8572-09e36dfc4bd2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ce6d53-79c4-4293-801b-4c47667fb8c2]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09567158-3a03-4db5-9721-7a6f9521ff59_l8pznyln {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:17 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.9d18e82a-f1d7-4ede-8572-09e36dfc4bd2 Sep 01 12:24:17 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:17 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09567158-3a03-4db5-9721-7a6f9521ff59_l8pznyln Sep 01 12:24:17 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:17 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2577ea7b-ce34-4e00-a15c-1eba8472c462 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-897a36ed-4a13-493a-9546-8ce787d09944" returned: 0 in 0.523s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2577ea7b-ce34-4e00-a15c-1eba8472c462 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-897a36ed-4a13-493a-9546-8ce787d09944 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:17 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-897a36ed-4a13-493a-9546-8ce787d09944 Sep 01 12:24:17 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:17 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b 1073741824" returned: 0 in 0.583s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:17 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.9d18e82a-f1d7-4ede-8572-09e36dfc4bd2" returned: 0 in 0.427s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08158d81-3054-46af-8d59-bdca4ec97bb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:24:17 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b Sep 01 12:24:17 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:17 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09567158-3a03-4db5-9721-7a6f9521ff59_l8pznyln" returned: 0 in 0.392s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09567158-3a03-4db5-9721-7a6f9521ff59_l8pznyln {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3039cc93-e780-45b2-b03f-09206f1bbfe7]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:17 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2577ea7b-ce34-4e00-a15c-1eba8472c462 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-897a36ed-4a13-493a-9546-8ce787d09944" returned: 0 in 0.291s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2577ea7b-ce34-4e00-a15c-1eba8472c462 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-quobyte-897a36ed-4a13-493a-9546-8ce787d09944" released by "delete_volume" :: held 0.915s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:17 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09567158-3a03-4db5-9721-7a6f9521ff59_l8pznyln Sep 01 12:24:17 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:17 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0 Sep 01 12:24:17 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-2577ea7b-ce34-4e00-a15c-1eba8472c462 tempest-CreateVolumesFromSnapshotTest-51667841 None] Created reservations ['c11f1e95-bdce-4c91-b16c-9dd1073dffe4', '2dc69d42-256f-4ecc-8ec6-e89edcdf9bce', 'e0a2583f-164d-4ae0-afc0-234f1e3dfe28', '88c171c1-23ae-467f-b302-9ce319320e15'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:17 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b" returned: 0 in 0.306s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df013c5-bbcc-421e-a457-2a76664adab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd830af6-257a-4f47-9d2d-ca90f7dea949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2577ea7b-ce34-4e00-a15c-1eba8472c462 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2577ea7b-ce34-4e00-a15c-1eba8472c462 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2577ea7b-ce34-4e00-a15c-1eba8472c462 tempest-CreateVolumesFromSnapshotTest-51667841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2577ea7b-ce34-4e00-a15c-1eba8472c462 tempest-CreateVolumesFromSnapshotTest-51667841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2577ea7b-ce34-4e00-a15c-1eba8472c462 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2577ea7b-ce34-4e00-a15c-1eba8472c462 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:17 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Volume volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b (436c3b5b-921b-4ddc-90aa-ef16fde77e5b): created successfully Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd830af6-257a-4f47-9d2d-ca90f7dea949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Flow 'volume_create_manager' (f4a18de4-05d4-4e0b-af7f-cc80e7704a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:17 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:17 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:17 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-45cfc38d-cb2f-46fd-a7dc-81625e6e1267 tempest-CinderUnicodeTest-1098367274 None] Created volume successfully. Sep 01 12:24:17 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09567158-3a03-4db5-9721-7a6f9521ff59_l8pznyln" returned: 1 in 0.391s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09567158-3a03-4db5-9721-7a6f9521ff59_l8pznyln' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7618d3-526f-4641-9090-994503b05c58]: (4, 'raw') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:18 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0" returned: 0 in 0.463s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.9d18e82a-f1d7-4ede-8572-09e36dfc4bd2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:18 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.9d18e82a-f1d7-4ede-8572-09e36dfc4bd2 Sep 01 12:24:18 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:18 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD Sep 01 12:24:18 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:18 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2577ea7b-ce34-4e00-a15c-1eba8472c462 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.293s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-2577ea7b-ce34-4e00-a15c-1eba8472c462 tempest-CreateVolumesFromSnapshotTest-51667841 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:18 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2577ea7b-ce34-4e00-a15c-1eba8472c462 tempest-CreateVolumesFromSnapshotTest-51667841 None] Deleted volume successfully. Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2577ea7b-ce34-4e00-a15c-1eba8472c462 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-897a36ed-4a13-493a-9546-8ce787d09944-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:18 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:18 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.9d18e82a-f1d7-4ede-8572-09e36dfc4bd2" returned: 0 in 0.442s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.9d18e82a-f1d7-4ede-8572-09e36dfc4bd2 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:18 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD Sep 01 12:24:18 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f2166c54-beea-4db8-9cc2-450e1afd60d9 tempest-CinderUnicodeTest-1098367274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f2166c54-beea-4db8-9cc2-450e1afd60d9 tempest-CinderUnicodeTest-1098367274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:18 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.9d18e82a-f1d7-4ede-8572-09e36dfc4bd2 Sep 01 12:24:18 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f2166c54-beea-4db8-9cc2-450e1afd60d9 tempest-CinderUnicodeTest-1098367274 None] Creating offline snapshot fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797 of volume 436c3b5b-921b-4ddc-90aa-ef16fde77e5b {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce388d4-2d5e-4ae0-96e5-3487c082cd18]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2166c54-beea-4db8-9cc2-450e1afd60d9 tempest-CinderUnicodeTest-1098367274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:18 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b Sep 01 12:24:18 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:18 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:18 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0.9d18e82a-f1d7-4ede-8572-09e36dfc4bd2" returned: 0 in 0.259s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] 09567158-3a03-4db5-9721-7a6f9521ff59 was raw, converting to qcow2 {{(pid=87084) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a1425460-7636-4981-8859-7b291896a489 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:18 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a1425460-7636-4981-8859-7b291896a489 Sep 01 12:24:18 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-9d18e82a-f1d7-4ede-8572-09e36dfc4bd2" released by "_delete_snapshot" :: held 1.788s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-08158d81-3054-46af-8d59-bdca4ec97bb0" released by "delete_snapshot" :: held 1.827s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "cinder-7a4526ab-f4b8-47b9-b77a-b5b0a3441195-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-7a4526ab-f4b8-47b9-b77a-b5b0a3441195-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "cinder-quobyte-7edcefc5-e31a-43db-bfd3-b02334e9a678" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-quobyte-7edcefc5-e31a-43db-bfd3-b02334e9a678" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "cinder-quobyte-7a4526ab-f4b8-47b9-b77a-b5b0a3441195" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:18 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2166c54-beea-4db8-9cc2-450e1afd60d9 tempest-CinderUnicodeTest-1098367274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b" returned: 0 in 0.412s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2166c54-beea-4db8-9cc2-450e1afd60d9 tempest-CinderUnicodeTest-1098367274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-quobyte-7a4526ab-f4b8-47b9-b77a-b5b0a3441195" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] Deleting offline snapshot 7a4526ab-f4b8-47b9-b77a-b5b0a3441195 of volume 7edcefc5-e31a-43db-bfd3-b02334e9a678 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:24:18 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797 1G Sep 01 12:24:18 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] snapshot_file for this snap is: volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.7a4526ab-f4b8-47b9-b77a-b5b0a3441195 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] Created reservations ['83cdb377-db49-44bb-ad3c-91914e53dcaa', '36a87150-26b9-4dcb-9536-aeda560d67b8', '9925907d-03f0-48a0-832d-875abeef466c', '6ea79bed-6441-4860-bdf4-187b3fd669b3'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff43375-7c84-41d6-93bb-5ce49965209b]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.7a4526ab-f4b8-47b9-b77a-b5b0a3441195 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:19 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] Delete snapshot completed successfully. Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ada8b023-f335-4b69-a9bd-725edf5198c5 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-9d18e82a-f1d7-4ede-8572-09e36dfc4bd2-delete_snapshot" released by "delete_snapshot" :: held 2.163s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:19 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.7a4526ab-f4b8-47b9-b77a-b5b0a3441195 Sep 01 12:24:19 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:19 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a1425460-7636-4981-8859-7b291896a489" returned: 0 in 0.528s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_09567158-3a03-4db5-9721-7a6f9521ff59_zy9iy1tndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a1425460-7636-4981-8859-7b291896a489 {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:24:19 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a1425460-7636-4981-8859-7b291896a489 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:19 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a1425460-7636-4981-8859-7b291896a489 1G Sep 01 12:24:19 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:19 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2166c54-beea-4db8-9cc2-450e1afd60d9 tempest-CinderUnicodeTest-1098367274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797 1G" returned: 0 in 0.441s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2166c54-beea-4db8-9cc2-450e1afd60d9 tempest-CinderUnicodeTest-1098367274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:19 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797 Sep 01 12:24:19 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:19 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.7a4526ab-f4b8-47b9-b77a-b5b0a3441195" returned: 0 in 0.429s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7edcefc5-e31a-43db-bfd3-b02334e9a678(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91e90c0-fc87-42c6-9a10-f7b70d749b2e]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:19 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a1425460-7636-4981-8859-7b291896a489 1G" returned: 0 in 0.320s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Downloaded image 09567158-3a03-4db5-9721-7a6f9521ff59 ((None, [{'url': 'file:///opt/stack/data/glance/images/09567158-3a03-4db5-9721-7a6f9521ff59', 'metadata': {}}])) to volume a1425460-7636-4981-8859-7b291896a489 successfully. {{(pid=87084) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Temporary image 09567158-3a03-4db5-9721-7a6f9521ff59 for user 18360b462acc4c5e85adfc846dc091ec is deleted. {{(pid=87084) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG cinder.volume.volume_utils [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Marking volume a1425460-7636-4981-8859-7b291896a489 as bootable. {{(pid=87084) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 12:24:19 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678 Sep 01 12:24:19 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Copying metadata from image 09567158-3a03-4db5-9721-7a6f9521ff59 to a1425460-7636-4981-8859-7b291896a489. {{(pid=87084) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Creating volume glance metadata for volume a1425460-7636-4981-8859-7b291896a489 backed by image 09567158-3a03-4db5-9721-7a6f9521ff59 with: {'image_id': '09567158-3a03-4db5-9721-7a6f9521ff59', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'cee978e9a76257129d8e87f3643cd940', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87084) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9bc7d30-6a75-4e33-9486-61d0085d2c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1425460-7636-4981-8859-7b291896a489', 'volume_size': 1, 'image_id': '09567158-3a03-4db5-9721-7a6f9521ff59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09567158-3a03-4db5-9721-7a6f9521ff59', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cee978e9a76257129d8e87f3643cd940', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1bd1a52d3e4f42bc81beb7586d30d4b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bf21bf75396cb0484dbce70c2bdbfc3f21ab87d9c0102af5ae6ff009886a0efb7d1d71bf5a79a43f7c4ee83b8b714cc74ac98c4531d6b3680cb2cd95bbb8ea23', 'id': '09567158-3a03-4db5-9721-7a6f9521ff59', 'created_at': datetime.datetime(2026, 9, 1, 10, 24, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 24, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09567158-3a03-4db5-9721-7a6f9521ff59/file', 'properties': {}}, 'image_service': }' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (669c7540-542a-47d1-8f98-932924961fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:19 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Volume volume-a1425460-7636-4981-8859-7b291896a489 (a1425460-7636-4981-8859-7b291896a489): created successfully Sep 01 12:24:19 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (669c7540-542a-47d1-8f98-932924961fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Flow 'volume_create_manager' (685da221-18f6-4505-88f3-98e0583914ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2166c54-beea-4db8-9cc2-450e1afd60d9 tempest-CinderUnicodeTest-1098367274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797" returned: 0 in 0.333s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:19 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-f2166c54-beea-4db8-9cc2-450e1afd60d9 tempest-CinderUnicodeTest-1098367274 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797 is being set with open permissions: ugo+rw Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2166c54-beea-4db8-9cc2-450e1afd60d9 tempest-CinderUnicodeTest-1098367274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:19 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-055936ba-5a17-4fd0-b8d4-c8e95091d7c7 tempest-VolumeImageDependencyTests-1780993616 None] Created volume successfully. Sep 01 12:24:19 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797 Sep 01 12:24:19 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:19 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678" returned: 0 in 0.384s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.7a4526ab-f4b8-47b9-b77a-b5b0a3441195 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:19 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.7a4526ab-f4b8-47b9-b77a-b5b0a3441195 Sep 01 12:24:19 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:19 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2166c54-beea-4db8-9cc2-450e1afd60d9 tempest-CinderUnicodeTest-1098367274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797" returned: 0 in 0.254s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2166c54-beea-4db8-9cc2-450e1afd60d9 tempest-CinderUnicodeTest-1098367274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:20 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.info Sep 01 12:24:20 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cf838ce2-68a5-4f65-93d3-5412715b96cf tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-08158d81-3054-46af-8d59-bdca4ec97bb0-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cf838ce2-68a5-4f65-93d3-5412715b96cf tempest-ProjectMemberTests-1072060943 None] Lock "cinder-08158d81-3054-46af-8d59-bdca4ec97bb0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cf838ce2-68a5-4f65-93d3-5412715b96cf tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-08158d81-3054-46af-8d59-bdca4ec97bb0" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cf838ce2-68a5-4f65-93d3-5412715b96cf tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-08158d81-3054-46af-8d59-bdca4ec97bb0" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[945ba829-bd35-4e2e-98ac-f071f98b14b7]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cf838ce2-68a5-4f65-93d3-5412715b96cf tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:20 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.7a4526ab-f4b8-47b9-b77a-b5b0a3441195" returned: 0 in 0.427s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.7a4526ab-f4b8-47b9-b77a-b5b0a3441195 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:20 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2166c54-beea-4db8-9cc2-450e1afd60d9 tempest-CinderUnicodeTest-1098367274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.info" returned: 0 in 0.320s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:20 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-f2166c54-beea-4db8-9cc2-450e1afd60d9 tempest-CinderUnicodeTest-1098367274 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.info is being set with open permissions: ugo+rw Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2166c54-beea-4db8-9cc2-450e1afd60d9 tempest-CinderUnicodeTest-1098367274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:20 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.7a4526ab-f4b8-47b9-b77a-b5b0a3441195 Sep 01 12:24:20 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:20 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.info Sep 01 12:24:20 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:20 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0 Sep 01 12:24:20 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ca727447-6559-4ce1-baae-0c68d6f4d4e9 tempest-VolumeImageDependencyTests-1780993616 None] Acquiring lock "cinder-a1425460-7636-4981-8859-7b291896a489-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ca727447-6559-4ce1-baae-0c68d6f4d4e9 tempest-VolumeImageDependencyTests-1780993616 None] Lock "cinder-a1425460-7636-4981-8859-7b291896a489-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ca727447-6559-4ce1-baae-0c68d6f4d4e9 tempest-VolumeImageDependencyTests-1780993616 None] Acquiring lock "cinder-quobyte-a1425460-7636-4981-8859-7b291896a489" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ca727447-6559-4ce1-baae-0c68d6f4d4e9 tempest-VolumeImageDependencyTests-1780993616 None] Lock "cinder-quobyte-a1425460-7636-4981-8859-7b291896a489" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[17457709-972a-4dae-8a35-ce3399f835c1]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ca727447-6559-4ce1-baae-0c68d6f4d4e9 tempest-VolumeImageDependencyTests-1780993616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a1425460-7636-4981-8859-7b291896a489 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:20 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678.7a4526ab-f4b8-47b9-b77a-b5b0a3441195" returned: 0 in 0.332s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:20 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-f2166c54-beea-4db8-9cc2-450e1afd60d9 tempest-CinderUnicodeTest-1098367274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.info" returned: 0 in 0.349s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:20 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-f2166c54-beea-4db8-9cc2-450e1afd60d9 tempest-CinderUnicodeTest-1098367274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.207s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-quobyte-7a4526ab-f4b8-47b9-b77a-b5b0a3441195" released by "_delete_snapshot" :: held 1.736s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cf838ce2-68a5-4f65-93d3-5412715b96cf tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0" returned: 0 in 0.444s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cf838ce2-68a5-4f65-93d3-5412715b96cf tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-quobyte-7edcefc5-e31a-43db-bfd3-b02334e9a678" released by "delete_snapshot" :: held 1.796s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:20 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0 Sep 01 12:24:20 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:20 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a1425460-7636-4981-8859-7b291896a489 Sep 01 12:24:20 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:20 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f2166c54-beea-4db8-9cc2-450e1afd60d9 tempest-CinderUnicodeTest-1098367274 None] Create snapshot completed successfully Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] Created reservations ['b1a10876-c5d9-4f5d-8f85-c3deb76ac4a3', '0ff2de11-76ac-46dc-9a70-af7f1180638e', 'e7833f17-f001-46ff-a3fe-c78f14313da2', '2caa26f0-5e9e-4b3d-8213-432981541b13'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:20 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] Delete snapshot completed successfully. Sep 01 12:24:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-f49686dc-1262-4bf9-89dd-fcc5e93a95e7 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-7a4526ab-f4b8-47b9-b77a-b5b0a3441195-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:20 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cf838ce2-68a5-4f65-93d3-5412715b96cf tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-08158d81-3054-46af-8d59-bdca4ec97bb0" returned: 0 in 0.285s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:21 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cf838ce2-68a5-4f65-93d3-5412715b96cf tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-08158d81-3054-46af-8d59-bdca4ec97bb0" released by "delete_volume" :: held 0.804s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ca727447-6559-4ce1-baae-0c68d6f4d4e9 tempest-VolumeImageDependencyTests-1780993616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a1425460-7636-4981-8859-7b291896a489" returned: 0 in 0.407s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ca727447-6559-4ce1-baae-0c68d6f4d4e9 tempest-VolumeImageDependencyTests-1780993616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a1425460-7636-4981-8859-7b291896a489 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-516a0b58-23cf-4cdc-8cb9-75b3b6671313 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "cinder-7edcefc5-e31a-43db-bfd3-b02334e9a678-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:21 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a1425460-7636-4981-8859-7b291896a489 Sep 01 12:24:21 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-516a0b58-23cf-4cdc-8cb9-75b3b6671313 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-7edcefc5-e31a-43db-bfd3-b02334e9a678-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-516a0b58-23cf-4cdc-8cb9-75b3b6671313 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "cinder-quobyte-7edcefc5-e31a-43db-bfd3-b02334e9a678" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-cf838ce2-68a5-4f65-93d3-5412715b96cf tempest-ProjectMemberTests-1072060943 None] Created reservations ['daabfcf0-893a-4339-b9b1-4433af7ccedd', '7a55a380-1b9b-4511-8df6-1292b52be525', '95d57ff9-c71f-430c-9293-e5d4e682bc04', '2f85ecd3-93d4-432f-ac66-4706948fc656'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-516a0b58-23cf-4cdc-8cb9-75b3b6671313 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-quobyte-7edcefc5-e31a-43db-bfd3-b02334e9a678" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9bfe1a-74e7-4f6f-829b-b4193051cbf4]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-516a0b58-23cf-4cdc-8cb9-75b3b6671313 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-cf838ce2-68a5-4f65-93d3-5412715b96cf tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-cf838ce2-68a5-4f65-93d3-5412715b96cf tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-cf838ce2-68a5-4f65-93d3-5412715b96cf tempest-ProjectMemberTests-1072060943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-cf838ce2-68a5-4f65-93d3-5412715b96cf tempest-ProjectMemberTests-1072060943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-cf838ce2-68a5-4f65-93d3-5412715b96cf tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cf838ce2-68a5-4f65-93d3-5412715b96cf tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:21 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:21 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:21 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ca727447-6559-4ce1-baae-0c68d6f4d4e9 tempest-VolumeImageDependencyTests-1780993616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a1425460-7636-4981-8859-7b291896a489" returned: 0 in 0.289s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:21 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678 Sep 01 12:24:21 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ca727447-6559-4ce1-baae-0c68d6f4d4e9 tempest-VolumeImageDependencyTests-1780993616 None] Lock "cinder-quobyte-a1425460-7636-4981-8859-7b291896a489" released by "delete_volume" :: held 0.765s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-ca727447-6559-4ce1-baae-0c68d6f4d4e9 tempest-VolumeImageDependencyTests-1780993616 None] Created reservations ['184cf09b-bd63-4795-858c-35341a79d28d', '4ef0f327-12ad-4bbe-8fa3-567d65c02810', '222d8ccd-480c-455b-b13a-fece5134567f', '4ddcbd0e-b54e-4cb5-bf83-682b2fc84ec2'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ca727447-6559-4ce1-baae-0c68d6f4d4e9 tempest-VolumeImageDependencyTests-1780993616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ca727447-6559-4ce1-baae-0c68d6f4d4e9 tempest-VolumeImageDependencyTests-1780993616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ca727447-6559-4ce1-baae-0c68d6f4d4e9 tempest-VolumeImageDependencyTests-1780993616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ca727447-6559-4ce1-baae-0c68d6f4d4e9 tempest-VolumeImageDependencyTests-1780993616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ca727447-6559-4ce1-baae-0c68d6f4d4e9 tempest-VolumeImageDependencyTests-1780993616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ca727447-6559-4ce1-baae-0c68d6f4d4e9 tempest-VolumeImageDependencyTests-1780993616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:21 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:21 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:21 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-cf838ce2-68a5-4f65-93d3-5412715b96cf tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.314s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-cf838ce2-68a5-4f65-93d3-5412715b96cf tempest-ProjectMemberTests-1072060943 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:21 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-cf838ce2-68a5-4f65-93d3-5412715b96cf tempest-ProjectMemberTests-1072060943 None] Deleted volume successfully. Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-cf838ce2-68a5-4f65-93d3-5412715b96cf tempest-ProjectMemberTests-1072060943 None] Lock "cinder-08158d81-3054-46af-8d59-bdca4ec97bb0-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:21 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-516a0b58-23cf-4cdc-8cb9-75b3b6671313 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678" returned: 0 in 0.474s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-516a0b58-23cf-4cdc-8cb9-75b3b6671313 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:21 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678 Sep 01 12:24:21 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] Acquiring lock "cinder-fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] Lock "cinder-fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] Acquiring lock "cinder-quobyte-436c3b5b-921b-4ddc-90aa-ef16fde77e5b" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] Lock "cinder-quobyte-436c3b5b-921b-4ddc-90aa-ef16fde77e5b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] Acquiring lock "cinder-quobyte-fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] Lock "cinder-quobyte-fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] Deleting offline snapshot fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797 of volume 436c3b5b-921b-4ddc-90aa-ef16fde77e5b {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] snapshot_file for this snap is: volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:24:21 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[777b271d-693a-4ed2-8b64-0e4903edb011]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ca727447-6559-4ce1-baae-0c68d6f4d4e9 tempest-VolumeImageDependencyTests-1780993616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.533s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-ca727447-6559-4ce1-baae-0c68d6f4d4e9 tempest-VolumeImageDependencyTests-1780993616 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:22 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ca727447-6559-4ce1-baae-0c68d6f4d4e9 tempest-VolumeImageDependencyTests-1780993616 None] Deleted volume successfully. Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Flow 'volume_create_manager' (bd27d3ea-c1e7-4842-9d2b-76f254289696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03592b4-c92c-47c6-8761-a5c91ed8a11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03592b4-c92c-47c6-8761-a5c91ed8a11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1956440884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=705fc5fa-9f5b-4131-be0f-e872417e71d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f303c21f6004c3b8f3683085fa69682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:22Z,use_quota=True,user_id='6630d9cae50f4034a07faed651147f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bcf7732-688b-4ec3-ae5d-29877c925bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:22 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bcf7732-688b-4ec3-ae5d-29877c925bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1750442-c38d-4e8e-b5d7-a3249f8c5894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1750442-c38d-4e8e-b5d7-a3249f8c5894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '705fc5fa-9f5b-4131-be0f-e872417e71d9', 'volume_name': 'volume-705fc5fa-9f5b-4131-be0f-e872417e71d9', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b2b32f-88c9-4cc3-8ef4-5e6238a38965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b2b32f-88c9-4cc3-8ef4-5e6238a38965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ba912f-3432-495f-a0cb-177057a56900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:22 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Volume 705fc5fa-9f5b-4131-be0f-e872417e71d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-705fc5fa-9f5b-4131-be0f-e872417e71d9', 'volume_size': 1} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1956440884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=705fc5fa-9f5b-4131-be0f-e872417e71d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f303c21f6004c3b8f3683085fa69682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:22Z,use_quota=True,user_id='6630d9cae50f4034a07faed651147f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Creating volume 705fc5fa-9f5b-4131-be0f-e872417e71d9 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:22 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797 Sep 01 12:24:22 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:24:22 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ca727447-6559-4ce1-baae-0c68d6f4d4e9 tempest-VolumeImageDependencyTests-1780993616 None] Lock "cinder-a1425460-7636-4981-8859-7b291896a489-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-516a0b58-23cf-4cdc-8cb9-75b3b6671313 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-7edcefc5-e31a-43db-bfd3-b02334e9a678" returned: 0 in 0.498s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:22 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9 1073741824 Sep 01 12:24:22 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-516a0b58-23cf-4cdc-8cb9-75b3b6671313 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-quobyte-7edcefc5-e31a-43db-bfd3-b02334e9a678" released by "delete_volume" :: held 1.049s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-516a0b58-23cf-4cdc-8cb9-75b3b6671313 tempest-CreateVolumesFromSnapshotTest-51667841 None] Created reservations ['b314476a-6197-4482-b456-5769daed1ccd', 'e2dabfdf-ab55-44e4-a393-b364ec98dcf5', '40cc0b7e-0ffd-4bdf-b876-ebe96a5e28a4', '35d8ad33-157f-4b88-9a24-0fb497c4564e'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-516a0b58-23cf-4cdc-8cb9-75b3b6671313 tempest-CreateVolumesFromSnapshotTest-51667841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-516a0b58-23cf-4cdc-8cb9-75b3b6671313 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-516a0b58-23cf-4cdc-8cb9-75b3b6671313 tempest-CreateVolumesFromSnapshotTest-51667841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-516a0b58-23cf-4cdc-8cb9-75b3b6671313 tempest-CreateVolumesFromSnapshotTest-51667841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-516a0b58-23cf-4cdc-8cb9-75b3b6671313 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-516a0b58-23cf-4cdc-8cb9-75b3b6671313 tempest-CreateVolumesFromSnapshotTest-51667841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:22 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:22 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:22 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797" returned: 0 in 0.461s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a8850d-66a0-4575-974a-876a7a417b0e]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:22 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:22 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-516a0b58-23cf-4cdc-8cb9-75b3b6671313 tempest-CreateVolumesFromSnapshotTest-51667841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.279s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:22 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:22 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-516a0b58-23cf-4cdc-8cb9-75b3b6671313 tempest-CreateVolumesFromSnapshotTest-51667841 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9 1073741824" returned: 0 in 0.501s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:22 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-516a0b58-23cf-4cdc-8cb9-75b3b6671313 tempest-CreateVolumesFromSnapshotTest-51667841 None] Deleted volume successfully. Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-516a0b58-23cf-4cdc-8cb9-75b3b6671313 tempest-CreateVolumesFromSnapshotTest-51667841 None] Lock "cinder-7edcefc5-e31a-43db-bfd3-b02334e9a678-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:22 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9 Sep 01 12:24:22 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:23 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b" returned: 0 in 0.517s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:23 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9" returned: 0 in 0.320s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:24:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ba912f-3432-495f-a0cb-177057a56900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-705fc5fa-9f5b-4131-be0f-e872417e71d9', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:23 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797 Sep 01 12:24:23 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4edb4cbf-a70b-40bf-aad1-575a3ab4cd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:23 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Volume volume-705fc5fa-9f5b-4131-be0f-e872417e71d9 (705fc5fa-9f5b-4131-be0f-e872417e71d9): created successfully Sep 01 12:24:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4edb4cbf-a70b-40bf-aad1-575a3ab4cd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:23 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Flow 'volume_create_manager' (bd27d3ea-c1e7-4842-9d2b-76f254289696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-42813e1a-196e-4522-a74a-b0527b6167fe tempest-ProjectMemberTests-1072060943 None] Created volume successfully. Sep 01 12:24:23 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797" returned: 0 in 0.442s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:23 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797 Sep 01 12:24:23 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:23 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b.fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797" returned: 0 in 0.281s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] Lock "cinder-quobyte-fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797" released by "_delete_snapshot" :: held 1.866s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] Lock "cinder-quobyte-436c3b5b-921b-4ddc-90aa-ef16fde77e5b" released by "delete_snapshot" :: held 1.899s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:23 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] Created reservations ['a9125a1c-da76-4ddd-abe4-d9120d5803d5', '31303399-8c7f-4da2-b037-72ac1d4fc9fc', 'f964022e-ade6-4a18-9f16-cf36562ae266', '7fcedc39-a207-489c-a274-05ada046a97d'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] Delete snapshot completed successfully. Sep 01 12:24:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-df851eb3-2f3d-4ad0-ad36-65862c4e87a9 tempest-CinderUnicodeTest-1098367274 None] Lock "cinder-fe7acb7f-cf24-4a62-a1bf-ac52e9a1d797-delete_snapshot" released by "delete_snapshot" :: held 2.101s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-456726f4-eea4-4b10-9b16-b1051700599d tempest-CinderUnicodeTest-1098367274 None] Acquiring lock "cinder-436c3b5b-921b-4ddc-90aa-ef16fde77e5b-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-456726f4-eea4-4b10-9b16-b1051700599d tempest-CinderUnicodeTest-1098367274 None] Lock "cinder-436c3b5b-921b-4ddc-90aa-ef16fde77e5b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-456726f4-eea4-4b10-9b16-b1051700599d tempest-CinderUnicodeTest-1098367274 None] Acquiring lock "cinder-quobyte-436c3b5b-921b-4ddc-90aa-ef16fde77e5b" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-456726f4-eea4-4b10-9b16-b1051700599d tempest-CinderUnicodeTest-1098367274 None] Lock "cinder-quobyte-436c3b5b-921b-4ddc-90aa-ef16fde77e5b" acquired by "delete_volume" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:24 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00a3621-1131-44d1-855d-9418c3ae8004]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-456726f4-eea4-4b10-9b16-b1051700599d tempest-CinderUnicodeTest-1098367274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2c19aa04-17b5-4345-ac54-622a8a34efdc tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2c19aa04-17b5-4345-ac54-622a8a34efdc tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2c19aa04-17b5-4345-ac54-622a8a34efdc tempest-ProjectMemberTests-1072060943 None] Creating offline snapshot dfda1b7f-12a8-4832-991b-049b37fdc26b of volume 705fc5fa-9f5b-4131-be0f-e872417e71d9 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:24:24 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0ece59-8a16-45fd-824e-45b9d9957f89]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2c19aa04-17b5-4345-ac54-622a8a34efdc tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:24 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b Sep 01 12:24:24 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:24 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9 Sep 01 12:24:24 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:24 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-456726f4-eea4-4b10-9b16-b1051700599d tempest-CinderUnicodeTest-1098367274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b" returned: 0 in 0.505s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-456726f4-eea4-4b10-9b16-b1051700599d tempest-CinderUnicodeTest-1098367274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:24 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b Sep 01 12:24:24 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:24 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2c19aa04-17b5-4345-ac54-622a8a34efdc tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9" returned: 0 in 0.432s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2c19aa04-17b5-4345-ac54-622a8a34efdc tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.dfda1b7f-12a8-4832-991b-049b37fdc26b 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:24 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.dfda1b7f-12a8-4832-991b-049b37fdc26b 1G Sep 01 12:24:24 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:25 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-456726f4-eea4-4b10-9b16-b1051700599d tempest-CinderUnicodeTest-1098367274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-436c3b5b-921b-4ddc-90aa-ef16fde77e5b" returned: 0 in 0.284s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-456726f4-eea4-4b10-9b16-b1051700599d tempest-CinderUnicodeTest-1098367274 None] Lock "cinder-quobyte-436c3b5b-921b-4ddc-90aa-ef16fde77e5b" released by "delete_volume" :: held 0.886s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:25 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-456726f4-eea4-4b10-9b16-b1051700599d tempest-CinderUnicodeTest-1098367274 None] Created reservations ['50372fb5-811d-489f-aee1-aa30d99e56ad', '660d3dc2-124b-41d2-bd64-d3f282368dd6', 'b3769e9e-dac4-48be-b749-353278235736', '27caf339-3cc4-4c61-b12b-66058474a181'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-456726f4-eea4-4b10-9b16-b1051700599d tempest-CinderUnicodeTest-1098367274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-456726f4-eea4-4b10-9b16-b1051700599d tempest-CinderUnicodeTest-1098367274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-456726f4-eea4-4b10-9b16-b1051700599d tempest-CinderUnicodeTest-1098367274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-456726f4-eea4-4b10-9b16-b1051700599d tempest-CinderUnicodeTest-1098367274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-456726f4-eea4-4b10-9b16-b1051700599d tempest-CinderUnicodeTest-1098367274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-456726f4-eea4-4b10-9b16-b1051700599d tempest-CinderUnicodeTest-1098367274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:25 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:25 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:25 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2c19aa04-17b5-4345-ac54-622a8a34efdc tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.dfda1b7f-12a8-4832-991b-049b37fdc26b 1G" returned: 0 in 0.589s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2c19aa04-17b5-4345-ac54-622a8a34efdc tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-705fc5fa-9f5b-4131-be0f-e872417e71d9 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.dfda1b7f-12a8-4832-991b-049b37fdc26b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:25 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-705fc5fa-9f5b-4131-be0f-e872417e71d9 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.dfda1b7f-12a8-4832-991b-049b37fdc26b Sep 01 12:24:25 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:25 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-456726f4-eea4-4b10-9b16-b1051700599d tempest-CinderUnicodeTest-1098367274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.324s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:25 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-456726f4-eea4-4b10-9b16-b1051700599d tempest-CinderUnicodeTest-1098367274 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:25 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-456726f4-eea4-4b10-9b16-b1051700599d tempest-CinderUnicodeTest-1098367274 None] Deleted volume successfully. Sep 01 12:24:25 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-456726f4-eea4-4b10-9b16-b1051700599d tempest-CinderUnicodeTest-1098367274 None] Lock "cinder-436c3b5b-921b-4ddc-90aa-ef16fde77e5b-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:25 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2c19aa04-17b5-4345-ac54-622a8a34efdc tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-705fc5fa-9f5b-4131-be0f-e872417e71d9 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.dfda1b7f-12a8-4832-991b-049b37fdc26b" returned: 0 in 0.382s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:25 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-2c19aa04-17b5-4345-ac54-622a8a34efdc tempest-ProjectMemberTests-1072060943 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.dfda1b7f-12a8-4832-991b-049b37fdc26b is being set with open permissions: ugo+rw Sep 01 12:24:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2c19aa04-17b5-4345-ac54-622a8a34efdc tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.dfda1b7f-12a8-4832-991b-049b37fdc26b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:25 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.dfda1b7f-12a8-4832-991b-049b37fdc26b Sep 01 12:24:25 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:26 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2c19aa04-17b5-4345-ac54-622a8a34efdc tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.dfda1b7f-12a8-4832-991b-049b37fdc26b" returned: 0 in 0.269s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2c19aa04-17b5-4345-ac54-622a8a34efdc tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:26 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.info Sep 01 12:24:26 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:26 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5a5435ad-052c-4f9e-bb3d-904acbc8c16d tempest-ProjectAdminTests-213463913 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9639739990234, 'free_capacity_gb': 1773.9639739990234, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87084) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 12:24:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-42bcee1c-5ec4-4b79-8ea8-9d165770ee6f tempest-CinderUnicodeTest-1098367274 None] Acquiring lock "cinder-a7e7effc-347f-47b6-b567-472750f4e0e6-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-42bcee1c-5ec4-4b79-8ea8-9d165770ee6f tempest-CinderUnicodeTest-1098367274 None] Lock "cinder-a7e7effc-347f-47b6-b567-472750f4e0e6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:26 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2c19aa04-17b5-4345-ac54-622a8a34efdc tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.info" returned: 0 in 0.322s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:26 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-2c19aa04-17b5-4345-ac54-622a8a34efdc tempest-ProjectMemberTests-1072060943 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.info is being set with open permissions: ugo+rw Sep 01 12:24:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2c19aa04-17b5-4345-ac54-622a8a34efdc tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-42bcee1c-5ec4-4b79-8ea8-9d165770ee6f tempest-CinderUnicodeTest-1098367274 None] Acquiring lock "cinder-quobyte-a7e7effc-347f-47b6-b567-472750f4e0e6" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:26 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.info Sep 01 12:24:26 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-42bcee1c-5ec4-4b79-8ea8-9d165770ee6f tempest-CinderUnicodeTest-1098367274 None] Lock "cinder-quobyte-a7e7effc-347f-47b6-b567-472750f4e0e6" acquired by "delete_volume" :: waited 0.032s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:26 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28947ab-cfe7-43ac-bfa1-f71ac3e14524]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42bcee1c-5ec4-4b79-8ea8-9d165770ee6f tempest-CinderUnicodeTest-1098367274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a7e7effc-347f-47b6-b567-472750f4e0e6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:26 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a7e7effc-347f-47b6-b567-472750f4e0e6 Sep 01 12:24:26 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:26 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2c19aa04-17b5-4345-ac54-622a8a34efdc tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.info" returned: 0 in 0.297s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2c19aa04-17b5-4345-ac54-622a8a34efdc tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.401s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:26 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2c19aa04-17b5-4345-ac54-622a8a34efdc tempest-ProjectMemberTests-1072060943 None] Create snapshot completed successfully Sep 01 12:24:26 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42bcee1c-5ec4-4b79-8ea8-9d165770ee6f tempest-CinderUnicodeTest-1098367274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a7e7effc-347f-47b6-b567-472750f4e0e6" returned: 0 in 0.459s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42bcee1c-5ec4-4b79-8ea8-9d165770ee6f tempest-CinderUnicodeTest-1098367274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a7e7effc-347f-47b6-b567-472750f4e0e6 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:27 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a7e7effc-347f-47b6-b567-472750f4e0e6 Sep 01 12:24:27 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:27 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42bcee1c-5ec4-4b79-8ea8-9d165770ee6f tempest-CinderUnicodeTest-1098367274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a7e7effc-347f-47b6-b567-472750f4e0e6" returned: 0 in 0.264s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-42bcee1c-5ec4-4b79-8ea8-9d165770ee6f tempest-CinderUnicodeTest-1098367274 None] Lock "cinder-quobyte-a7e7effc-347f-47b6-b567-472750f4e0e6" released by "delete_volume" :: held 0.776s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-42bcee1c-5ec4-4b79-8ea8-9d165770ee6f tempest-CinderUnicodeTest-1098367274 None] Created reservations ['b69528ab-8df9-4a1b-bcaf-b1295d0b2c91', '419d1706-99b9-4edb-9613-76c68cf338ee', 'b30b3f64-6f23-478d-9c9d-ad637f843ebd', 'd2dcfbe8-d1d9-4396-812e-b4581d0ac1c1'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-42bcee1c-5ec4-4b79-8ea8-9d165770ee6f tempest-CinderUnicodeTest-1098367274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-42bcee1c-5ec4-4b79-8ea8-9d165770ee6f tempest-CinderUnicodeTest-1098367274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-42bcee1c-5ec4-4b79-8ea8-9d165770ee6f tempest-CinderUnicodeTest-1098367274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-42bcee1c-5ec4-4b79-8ea8-9d165770ee6f tempest-CinderUnicodeTest-1098367274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-42bcee1c-5ec4-4b79-8ea8-9d165770ee6f tempest-CinderUnicodeTest-1098367274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42bcee1c-5ec4-4b79-8ea8-9d165770ee6f tempest-CinderUnicodeTest-1098367274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:27 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:27 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-dfda1b7f-12a8-4832-991b-049b37fdc26b-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-dfda1b7f-12a8-4832-991b-049b37fdc26b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-705fc5fa-9f5b-4131-be0f-e872417e71d9" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-705fc5fa-9f5b-4131-be0f-e872417e71d9" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-dfda1b7f-12a8-4832-991b-049b37fdc26b" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-dfda1b7f-12a8-4832-991b-049b37fdc26b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] Deleting offline snapshot dfda1b7f-12a8-4832-991b-049b37fdc26b of volume 705fc5fa-9f5b-4131-be0f-e872417e71d9 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] snapshot_file for this snap is: volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.dfda1b7f-12a8-4832-991b-049b37fdc26b {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[26456270-729f-4ecc-8b1a-f8500b47f387]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.dfda1b7f-12a8-4832-991b-049b37fdc26b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:27 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-42bcee1c-5ec4-4b79-8ea8-9d165770ee6f tempest-CinderUnicodeTest-1098367274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.414s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-42bcee1c-5ec4-4b79-8ea8-9d165770ee6f tempest-CinderUnicodeTest-1098367274 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:27 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-42bcee1c-5ec4-4b79-8ea8-9d165770ee6f tempest-CinderUnicodeTest-1098367274 None] Deleted volume successfully. Sep 01 12:24:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-42bcee1c-5ec4-4b79-8ea8-9d165770ee6f tempest-CinderUnicodeTest-1098367274 None] Lock "cinder-a7e7effc-347f-47b6-b567-472750f4e0e6-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:27 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.dfda1b7f-12a8-4832-991b-049b37fdc26b Sep 01 12:24:27 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:28 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.dfda1b7f-12a8-4832-991b-049b37fdc26b" returned: 0 in 0.457s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-705fc5fa-9f5b-4131-be0f-e872417e71d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:24:28 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4f6c99-1594-450f-81e6-8164914c431d]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:28 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9 Sep 01 12:24:28 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:28 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9" returned: 0 in 0.474s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.dfda1b7f-12a8-4832-991b-049b37fdc26b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:28 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.dfda1b7f-12a8-4832-991b-049b37fdc26b Sep 01 12:24:28 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:29 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.dfda1b7f-12a8-4832-991b-049b37fdc26b" returned: 0 in 0.449s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.dfda1b7f-12a8-4832-991b-049b37fdc26b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:29 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.dfda1b7f-12a8-4832-991b-049b37fdc26b Sep 01 12:24:29 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:29 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:29 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9.dfda1b7f-12a8-4832-991b-049b37fdc26b" returned: 0 in 0.336s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:29 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=287,cinder:SELECT=228,cinder:DELETE=23,cinder:INSERT=93 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:24:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-dfda1b7f-12a8-4832-991b-049b37fdc26b" released by "_delete_snapshot" :: held 1.876s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-705fc5fa-9f5b-4131-be0f-e872417e71d9" released by "delete_snapshot" :: held 1.909s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:29 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] Created reservations ['a6791458-2896-4b1f-8a5e-d2e5efd97fb7', 'd84ea339-bb00-483a-869a-b77f280d41d9', '10899939-1036-44d1-9142-7e3ba2db9073', '30d8a9af-ef40-4c94-bb16-f84fef00b3eb'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:29 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] Delete snapshot completed successfully. Sep 01 12:24:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-61b6299e-e365-40f1-9eb2-c572b64aee74 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-dfda1b7f-12a8-4832-991b-049b37fdc26b-delete_snapshot" released by "delete_snapshot" :: held 2.086s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ca438f23-d2cd-4146-a158-2dfb0bca966e tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-705fc5fa-9f5b-4131-be0f-e872417e71d9-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ca438f23-d2cd-4146-a158-2dfb0bca966e tempest-ProjectMemberTests-1072060943 None] Lock "cinder-705fc5fa-9f5b-4131-be0f-e872417e71d9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ca438f23-d2cd-4146-a158-2dfb0bca966e tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-705fc5fa-9f5b-4131-be0f-e872417e71d9" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ca438f23-d2cd-4146-a158-2dfb0bca966e tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-705fc5fa-9f5b-4131-be0f-e872417e71d9" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:30 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b3d07c-ed80-4f9e-9597-9e5c1afdbf83]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ca438f23-d2cd-4146-a158-2dfb0bca966e tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:30 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9 Sep 01 12:24:30 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:30 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ca438f23-d2cd-4146-a158-2dfb0bca966e tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9" returned: 0 in 0.427s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ca438f23-d2cd-4146-a158-2dfb0bca966e tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:30 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9 Sep 01 12:24:30 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:30 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ca438f23-d2cd-4146-a158-2dfb0bca966e tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-705fc5fa-9f5b-4131-be0f-e872417e71d9" returned: 0 in 0.414s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ca438f23-d2cd-4146-a158-2dfb0bca966e tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-705fc5fa-9f5b-4131-be0f-e872417e71d9" released by "delete_volume" :: held 0.927s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:31 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-ca438f23-d2cd-4146-a158-2dfb0bca966e tempest-ProjectMemberTests-1072060943 None] Created reservations ['2b661cb4-4d9b-4671-9b2c-0658fbc54b98', 'b17c0536-fedf-4c05-968b-dc20799dc4ab', '0b7611dd-6501-4624-bca0-b668aa313746', '36a786e7-df38-4fe2-8e2d-97ea3eaa6059'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ca438f23-d2cd-4146-a158-2dfb0bca966e tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ca438f23-d2cd-4146-a158-2dfb0bca966e tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ca438f23-d2cd-4146-a158-2dfb0bca966e tempest-ProjectMemberTests-1072060943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ca438f23-d2cd-4146-a158-2dfb0bca966e tempest-ProjectMemberTests-1072060943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ca438f23-d2cd-4146-a158-2dfb0bca966e tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ca438f23-d2cd-4146-a158-2dfb0bca966e tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:31 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:31 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:31 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ca438f23-d2cd-4146-a158-2dfb0bca966e tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.341s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:31 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-ca438f23-d2cd-4146-a158-2dfb0bca966e tempest-ProjectMemberTests-1072060943 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ca438f23-d2cd-4146-a158-2dfb0bca966e tempest-ProjectMemberTests-1072060943 None] Deleted volume successfully. Sep 01 12:24:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-ca438f23-d2cd-4146-a158-2dfb0bca966e tempest-ProjectMemberTests-1072060943 None] Lock "cinder-705fc5fa-9f5b-4131-be0f-e872417e71d9-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:32 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:24:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Flow 'volume_create_manager' (5490976d-3651-43dd-9431-c4453f6373b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63dc381d-0a43-4387-83c5-0a671502810f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63dc381d-0a43-4387-83c5-0a671502810f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-129526054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6fcb77-626a-4f2b-8700-cdbdb984753e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f303c21f6004c3b8f3683085fa69682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:33Z,use_quota=True,user_id='6630d9cae50f4034a07faed651147f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f866f3-9311-4945-bc54-aa2a364280a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f866f3-9311-4945-bc54-aa2a364280a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2c7e37-1185-4cfe-b7c2-123915a4e8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2c7e37-1185-4cfe-b7c2-123915a4e8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d6fcb77-626a-4f2b-8700-cdbdb984753e', 'volume_name': 'volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd961cf-40ad-4b44-8329-d6856b5b6fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd961cf-40ad-4b44-8329-d6856b5b6fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d323c63-1935-424d-9ecc-23a860e36daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:32 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Volume 0d6fcb77-626a-4f2b-8700-cdbdb984753e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e', 'volume_size': 1} Sep 01 12:24:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-129526054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6fcb77-626a-4f2b-8700-cdbdb984753e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f303c21f6004c3b8f3683085fa69682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:33Z,use_quota=True,user_id='6630d9cae50f4034a07faed651147f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:24:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Creating volume 0d6fcb77-626a-4f2b-8700-cdbdb984753e {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:24:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:24:33 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:24:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:33 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e 1073741824 Sep 01 12:24:33 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:33 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e 1073741824" returned: 0 in 0.485s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:33 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e Sep 01 12:24:33 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:33 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e" returned: 0 in 0.327s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:24:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d323c63-1935-424d-9ecc-23a860e36daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31381ceb-789a-4203-a7da-b1eb033e1274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:33 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Volume volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e (0d6fcb77-626a-4f2b-8700-cdbdb984753e): created successfully Sep 01 12:24:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31381ceb-789a-4203-a7da-b1eb033e1274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Flow 'volume_create_manager' (5490976d-3651-43dd-9431-c4453f6373b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-76360e82-dffd-4fad-b4d8-5b75b94f0da0 tempest-ProjectMemberTests-1072060943 None] Created volume successfully. Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Flow 'volume_create_manager' (7ff5167c-aa0a-4f02-a26a-fb7810d17a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d60f45b-ca1a-4b61-ac14-ced20a203cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d60f45b-ca1a-4b61-ac14-ced20a203cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1287814012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40470ab6-4a7e-41c1-8d45-8adbf6f739c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554d1f313f4d41198140f854d4acc488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:35Z,use_quota=True,user_id='70a0758d24234e578aa505d1ca02821b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7aa2d0-6b3d-4342-9e95-4d44327e05c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7aa2d0-6b3d-4342-9e95-4d44327e05c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a882e1a3-a311-4326-9c72-3f8860498bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a882e1a3-a311-4326-9c72-3f8860498bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40470ab6-4a7e-41c1-8d45-8adbf6f739c9', 'volume_name': 'volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297a7085-8dcb-4332-947d-cd8bef0ccade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297a7085-8dcb-4332-947d-cd8bef0ccade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed92dff-497b-4bae-957b-de09a3a2e260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:35 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Volume 40470ab6-4a7e-41c1-8d45-8adbf6f739c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9', 'volume_size': 1} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1287814012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40470ab6-4a7e-41c1-8d45-8adbf6f739c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554d1f313f4d41198140f854d4acc488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:35Z,use_quota=True,user_id='70a0758d24234e578aa505d1ca02821b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Creating volume 40470ab6-4a7e-41c1-8d45-8adbf6f739c9 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:24:35 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:35 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9 1073741824 Sep 01 12:24:35 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fa897526-8f44-4cf0-99b8-0129f0951202 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:35 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9 1073741824" returned: 0 in 0.427s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:35 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9 Sep 01 12:24:35 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:35 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9" returned: 0 in 0.264s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fa897526-8f44-4cf0-99b8-0129f0951202 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.662s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed92dff-497b-4bae-957b-de09a3a2e260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff64a2f8-1a01-471a-83ef-aebb94bce70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-fa897526-8f44-4cf0-99b8-0129f0951202 tempest-ProjectMemberTests-1072060943 None] Creating offline snapshot 255add21-9790-4c20-80b2-615c6e4a8a3d of volume 0d6fcb77-626a-4f2b-8700-cdbdb984753e {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:24:35 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Volume volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9 (40470ab6-4a7e-41c1-8d45-8adbf6f739c9): created successfully Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff64a2f8-1a01-471a-83ef-aebb94bce70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Flow 'volume_create_manager' (7ff5167c-aa0a-4f02-a26a-fb7810d17a19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddfdb35-0202-4760-b9f8-60cb10dd2e1c]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa897526-8f44-4cf0-99b8-0129f0951202 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:35 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4a445c38-1661-4e01-9e0a-0eee12ecdedc tempest-ProjectReaderTests-507375670 None] Created volume successfully. Sep 01 12:24:36 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e Sep 01 12:24:36 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:36 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa897526-8f44-4cf0-99b8-0129f0951202 tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e" returned: 0 in 0.377s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa897526-8f44-4cf0-99b8-0129f0951202 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.255add21-9790-4c20-80b2-615c6e4a8a3d 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:36 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.255add21-9790-4c20-80b2-615c6e4a8a3d 1G Sep 01 12:24:36 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:36 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa897526-8f44-4cf0-99b8-0129f0951202 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.255add21-9790-4c20-80b2-615c6e4a8a3d 1G" returned: 0 in 0.405s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa897526-8f44-4cf0-99b8-0129f0951202 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.255add21-9790-4c20-80b2-615c6e4a8a3d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:36 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.255add21-9790-4c20-80b2-615c6e4a8a3d Sep 01 12:24:36 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:37 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa897526-8f44-4cf0-99b8-0129f0951202 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.255add21-9790-4c20-80b2-615c6e4a8a3d" returned: 0 in 0.312s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:37 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-fa897526-8f44-4cf0-99b8-0129f0951202 tempest-ProjectMemberTests-1072060943 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.255add21-9790-4c20-80b2-615c6e4a8a3d is being set with open permissions: ugo+rw Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa897526-8f44-4cf0-99b8-0129f0951202 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.255add21-9790-4c20-80b2-615c6e4a8a3d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:37 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.255add21-9790-4c20-80b2-615c6e4a8a3d Sep 01 12:24:37 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-69b4c5d2-a5ee-4509-bc82-7b2ec45c60dd tempest-ProjectReaderTests-507375670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:37 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa897526-8f44-4cf0-99b8-0129f0951202 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.255add21-9790-4c20-80b2-615c6e4a8a3d" returned: 0 in 0.281s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa897526-8f44-4cf0-99b8-0129f0951202 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:37 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.info Sep 01 12:24:37 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:37 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa897526-8f44-4cf0-99b8-0129f0951202 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.info" returned: 0 in 0.256s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:37 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-fa897526-8f44-4cf0-99b8-0129f0951202 tempest-ProjectMemberTests-1072060943 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.info is being set with open permissions: ugo+rw Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa897526-8f44-4cf0-99b8-0129f0951202 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:37 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.info Sep 01 12:24:37 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Flow 'volume_create_manager' (0d8e12d0-2a8d-4996-bd69-b3563295bd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26dc4391-e449-436b-8ed8-5f7bb2b67cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26dc4391-e449-436b-8ed8-5f7bb2b67cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-971653621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1386441f-9311-42c2-8188-21d8c79660d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d98b238068488682be67b2c48990b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:38Z,use_quota=True,user_id='ce6b871337cb4f498c62c04a0b07b1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f13b50b-cc61-4913-9446-2d120b13c7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f13b50b-cc61-4913-9446-2d120b13c7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ec6ed6-c1b6-426a-a6a2-cfbd14e14a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ec6ed6-c1b6-426a-a6a2-cfbd14e14a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1386441f-9311-42c2-8188-21d8c79660d9', 'volume_name': 'volume-1386441f-9311-42c2-8188-21d8c79660d9', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9630da-8890-4398-aa96-577ea02fea6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9630da-8890-4398-aa96-577ea02fea6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7f3d48-b357-4a26-835f-2e6aad240b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:37 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Volume 1386441f-9311-42c2-8188-21d8c79660d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1386441f-9311-42c2-8188-21d8c79660d9', 'volume_size': 1} Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:37 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-fa897526-8f44-4cf0-99b8-0129f0951202 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.info" returned: 0 in 0.257s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-fa897526-8f44-4cf0-99b8-0129f0951202 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.999s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-69b4c5d2-a5ee-4509-bc82-7b2ec45c60dd tempest-ProjectReaderTests-507375670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.607s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-69b4c5d2-a5ee-4509-bc82-7b2ec45c60dd tempest-ProjectReaderTests-507375670 None] Creating offline snapshot 2a6c528b-43c1-4cb8-888d-cc09887b32fd of volume 40470ab6-4a7e-41c1-8d45-8adbf6f739c9 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:24:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-fa897526-8f44-4cf0-99b8-0129f0951202 tempest-ProjectMemberTests-1072060943 None] Create snapshot completed successfully Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[94514efb-e7ba-4698-a6b1-e67adfd5623b]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-69b4c5d2-a5ee-4509-bc82-7b2ec45c60dd tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:38 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9 Sep 01 12:24:38 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:38 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-69b4c5d2-a5ee-4509-bc82-7b2ec45c60dd tempest-ProjectReaderTests-507375670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9" returned: 0 in 0.356s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-69b4c5d2-a5ee-4509-bc82-7b2ec45c60dd tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.2a6c528b-43c1-4cb8-888d-cc09887b32fd 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:38 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.2a6c528b-43c1-4cb8-888d-cc09887b32fd 1G Sep 01 12:24:38 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-255add21-9790-4c20-80b2-615c6e4a8a3d-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] Lock "cinder-255add21-9790-4c20-80b2-615c6e4a8a3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-0d6fcb77-626a-4f2b-8700-cdbdb984753e" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-0d6fcb77-626a-4f2b-8700-cdbdb984753e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-255add21-9790-4c20-80b2-615c6e4a8a3d" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-255add21-9790-4c20-80b2-615c6e4a8a3d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] Deleting offline snapshot 255add21-9790-4c20-80b2-615c6e4a8a3d of volume 0d6fcb77-626a-4f2b-8700-cdbdb984753e {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:24:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] snapshot_file for this snap is: volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.255add21-9790-4c20-80b2-615c6e4a8a3d {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:24:38 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc6c12a-8b2a-496e-b24e-390c992f8823]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.255add21-9790-4c20-80b2-615c6e4a8a3d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:38 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.255add21-9790-4c20-80b2-615c6e4a8a3d Sep 01 12:24:38 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:38 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-69b4c5d2-a5ee-4509-bc82-7b2ec45c60dd tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.2a6c528b-43c1-4cb8-888d-cc09887b32fd 1G" returned: 0 in 0.405s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-69b4c5d2-a5ee-4509-bc82-7b2ec45c60dd tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.2a6c528b-43c1-4cb8-888d-cc09887b32fd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:38 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.2a6c528b-43c1-4cb8-888d-cc09887b32fd Sep 01 12:24:38 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:38 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.255add21-9790-4c20-80b2-615c6e4a8a3d" returned: 0 in 0.384s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:24:38 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c04520b-387f-4dfb-89a7-3d58ade205ee]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:39 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-69b4c5d2-a5ee-4509-bc82-7b2ec45c60dd tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.2a6c528b-43c1-4cb8-888d-cc09887b32fd" returned: 0 in 0.306s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:39 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-69b4c5d2-a5ee-4509-bc82-7b2ec45c60dd tempest-ProjectReaderTests-507375670 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.2a6c528b-43c1-4cb8-888d-cc09887b32fd is being set with open permissions: ugo+rw Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-69b4c5d2-a5ee-4509-bc82-7b2ec45c60dd tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.2a6c528b-43c1-4cb8-888d-cc09887b32fd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:39 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e Sep 01 12:24:39 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:39 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.2a6c528b-43c1-4cb8-888d-cc09887b32fd Sep 01 12:24:39 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:39 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-69b4c5d2-a5ee-4509-bc82-7b2ec45c60dd tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.2a6c528b-43c1-4cb8-888d-cc09887b32fd" returned: 0 in 0.246s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=237,cinder:UPDATE=333,cinder:INSERT=74,cinder:DELETE=33 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:24:39 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e" returned: 0 in 0.371s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.255add21-9790-4c20-80b2-615c6e4a8a3d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-69b4c5d2-a5ee-4509-bc82-7b2ec45c60dd tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:39 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.255add21-9790-4c20-80b2-615c6e4a8a3d Sep 01 12:24:39 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:39 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.info Sep 01 12:24:39 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:39 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-69b4c5d2-a5ee-4509-bc82-7b2ec45c60dd tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.info" returned: 0 in 0.271s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:39 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-69b4c5d2-a5ee-4509-bc82-7b2ec45c60dd tempest-ProjectReaderTests-507375670 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.info is being set with open permissions: ugo+rw Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-69b4c5d2-a5ee-4509-bc82-7b2ec45c60dd tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:39 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.info Sep 01 12:24:39 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:39 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.255add21-9790-4c20-80b2-615c6e4a8a3d" returned: 0 in 0.344s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.255add21-9790-4c20-80b2-615c6e4a8a3d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:39 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.255add21-9790-4c20-80b2-615c6e4a8a3d Sep 01 12:24:39 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:39 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-69b4c5d2-a5ee-4509-bc82-7b2ec45c60dd tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.info" returned: 0 in 0.255s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-69b4c5d2-a5ee-4509-bc82-7b2ec45c60dd tempest-ProjectReaderTests-507375670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.070s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-971653621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1386441f-9311-42c2-8188-21d8c79660d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d98b238068488682be67b2c48990b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:38Z,use_quota=True,user_id='ce6b871337cb4f498c62c04a0b07b1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Creating volume 1386441f-9311-42c2-8188-21d8c79660d9 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:24:39 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1386441f-9311-42c2-8188-21d8c79660d9 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:39 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e.255add21-9790-4c20-80b2-615c6e4a8a3d" returned: 0 in 0.254s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:39 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1386441f-9311-42c2-8188-21d8c79660d9 1073741824 Sep 01 12:24:39 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-255add21-9790-4c20-80b2-615c6e4a8a3d" released by "_delete_snapshot" :: held 1.452s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-0d6fcb77-626a-4f2b-8700-cdbdb984753e" released by "delete_snapshot" :: held 1.477s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:39 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-69b4c5d2-a5ee-4509-bc82-7b2ec45c60dd tempest-ProjectReaderTests-507375670 None] Create snapshot completed successfully Sep 01 12:24:39 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] Created reservations ['05e2de49-3a68-47b4-a2d9-16dfecda6507', '25ae07d0-44ef-4004-a359-4a7f7a4b267b', '2b67a058-d32e-46f6-af64-8c255f8ccca9', '2e3189c7-94e3-4f56-998c-92329c95e09f'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:40 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] Delete snapshot completed successfully. Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-8243fa55-1bb5-4c74-aca3-4da1075b661d tempest-ProjectMemberTests-1072060943 None] Lock "cinder-255add21-9790-4c20-80b2-615c6e4a8a3d-delete_snapshot" released by "delete_snapshot" :: held 1.624s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:40 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1386441f-9311-42c2-8188-21d8c79660d9 1073741824" returned: 0 in 0.405s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1386441f-9311-42c2-8188-21d8c79660d9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:40 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1386441f-9311-42c2-8188-21d8c79660d9 Sep 01 12:24:40 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:40 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1386441f-9311-42c2-8188-21d8c79660d9" returned: 0 in 0.247s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-2a6c528b-43c1-4cb8-888d-cc09887b32fd-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a40e693f-c749-4353-9b32-0d7eeb6a53cc tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-0d6fcb77-626a-4f2b-8700-cdbdb984753e-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7f3d48-b357-4a26-835f-2e6aad240b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1386441f-9311-42c2-8188-21d8c79660d9', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb2d086-7f32-4db4-82e6-704d1aa682ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] Lock "cinder-2a6c528b-43c1-4cb8-888d-cc09887b32fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-quobyte-40470ab6-4a7e-41c1-8d45-8adbf6f739c9" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a40e693f-c749-4353-9b32-0d7eeb6a53cc tempest-ProjectMemberTests-1072060943 None] Lock "cinder-0d6fcb77-626a-4f2b-8700-cdbdb984753e-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:40 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Volume volume-1386441f-9311-42c2-8188-21d8c79660d9 (1386441f-9311-42c2-8188-21d8c79660d9): created successfully Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb2d086-7f32-4db4-82e6-704d1aa682ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Flow 'volume_create_manager' (0d8e12d0-2a8d-4996-bd69-b3563295bd97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-40470ab6-4a7e-41c1-8d45-8adbf6f739c9" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-quobyte-2a6c528b-43c1-4cb8-888d-cc09887b32fd" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:40 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0f89fcea-95bd-4e56-ae03-eed0b0788e8f tempest-ProjectReaderTests-963792890 None] Created volume successfully. Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-2a6c528b-43c1-4cb8-888d-cc09887b32fd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] Deleting offline snapshot 2a6c528b-43c1-4cb8-888d-cc09887b32fd of volume 40470ab6-4a7e-41c1-8d45-8adbf6f739c9 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] snapshot_file for this snap is: volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.2a6c528b-43c1-4cb8-888d-cc09887b32fd {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a40e693f-c749-4353-9b32-0d7eeb6a53cc tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-0d6fcb77-626a-4f2b-8700-cdbdb984753e" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b45c2a-2dfe-45a1-ab4f-930223c4e751]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.2a6c528b-43c1-4cb8-888d-cc09887b32fd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a40e693f-c749-4353-9b32-0d7eeb6a53cc tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-0d6fcb77-626a-4f2b-8700-cdbdb984753e" acquired by "delete_volume" :: waited 0.028s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[916574ca-afc1-4752-ae72-ae57de99cd7f]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a40e693f-c749-4353-9b32-0d7eeb6a53cc tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:40 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.2a6c528b-43c1-4cb8-888d-cc09887b32fd Sep 01 12:24:40 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:40 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e Sep 01 12:24:40 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4e4ebe1b-ecae-4782-a7e2-7c4beca428b9 tempest-ProjectReaderTests-963792890 None] Acquiring lock "cinder-1386441f-9311-42c2-8188-21d8c79660d9-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4e4ebe1b-ecae-4782-a7e2-7c4beca428b9 tempest-ProjectReaderTests-963792890 None] Lock "cinder-1386441f-9311-42c2-8188-21d8c79660d9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4e4ebe1b-ecae-4782-a7e2-7c4beca428b9 tempest-ProjectReaderTests-963792890 None] Acquiring lock "cinder-quobyte-1386441f-9311-42c2-8188-21d8c79660d9" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4e4ebe1b-ecae-4782-a7e2-7c4beca428b9 tempest-ProjectReaderTests-963792890 None] Lock "cinder-quobyte-1386441f-9311-42c2-8188-21d8c79660d9" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5f5bc5-8351-40d0-a867-2dacacc06fa0]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:41 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4e4ebe1b-ecae-4782-a7e2-7c4beca428b9 tempest-ProjectReaderTests-963792890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1386441f-9311-42c2-8188-21d8c79660d9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.2a6c528b-43c1-4cb8-888d-cc09887b32fd" returned: 0 in 0.444s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[93edbc77-331b-4249-b1f6-e8255d3ba1c2]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:41 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a40e693f-c749-4353-9b32-0d7eeb6a53cc tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e" returned: 0 in 0.425s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a40e693f-c749-4353-9b32-0d7eeb6a53cc tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:41 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e Sep 01 12:24:41 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:41 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1386441f-9311-42c2-8188-21d8c79660d9 Sep 01 12:24:41 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:41 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9 Sep 01 12:24:41 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:41 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a40e693f-c749-4353-9b32-0d7eeb6a53cc tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0d6fcb77-626a-4f2b-8700-cdbdb984753e" returned: 0 in 0.263s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a40e693f-c749-4353-9b32-0d7eeb6a53cc tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-0d6fcb77-626a-4f2b-8700-cdbdb984753e" released by "delete_volume" :: held 0.758s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:41 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4e4ebe1b-ecae-4782-a7e2-7c4beca428b9 tempest-ProjectReaderTests-963792890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1386441f-9311-42c2-8188-21d8c79660d9" returned: 0 in 0.368s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4e4ebe1b-ecae-4782-a7e2-7c4beca428b9 tempest-ProjectReaderTests-963792890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1386441f-9311-42c2-8188-21d8c79660d9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:41 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1386441f-9311-42c2-8188-21d8c79660d9 Sep 01 12:24:41 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:41 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9" returned: 0 in 0.380s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.2a6c528b-43c1-4cb8-888d-cc09887b32fd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a40e693f-c749-4353-9b32-0d7eeb6a53cc tempest-ProjectMemberTests-1072060943 None] Created reservations ['a7a06f11-4ab8-4ded-ab09-a1eabe8d2555', 'ed980cdc-e742-47d5-9c9a-97b983cc04b8', '5b47bf63-68ea-44fd-875b-66764d05ae21', 'c28a1fdd-0050-4200-bb19-3aaf17375fea'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:41 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.2a6c528b-43c1-4cb8-888d-cc09887b32fd Sep 01 12:24:41 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a40e693f-c749-4353-9b32-0d7eeb6a53cc tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a40e693f-c749-4353-9b32-0d7eeb6a53cc tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a40e693f-c749-4353-9b32-0d7eeb6a53cc tempest-ProjectMemberTests-1072060943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a40e693f-c749-4353-9b32-0d7eeb6a53cc tempest-ProjectMemberTests-1072060943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a40e693f-c749-4353-9b32-0d7eeb6a53cc tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a40e693f-c749-4353-9b32-0d7eeb6a53cc tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:41 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:41 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:41 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4e4ebe1b-ecae-4782-a7e2-7c4beca428b9 tempest-ProjectReaderTests-963792890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1386441f-9311-42c2-8188-21d8c79660d9" returned: 0 in 0.302s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4e4ebe1b-ecae-4782-a7e2-7c4beca428b9 tempest-ProjectReaderTests-963792890 None] Lock "cinder-quobyte-1386441f-9311-42c2-8188-21d8c79660d9" released by "delete_volume" :: held 0.750s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:41 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:41 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-4e4ebe1b-ecae-4782-a7e2-7c4beca428b9 tempest-ProjectReaderTests-963792890 None] Created reservations ['c4880c67-b789-44f2-b223-013d04b8d67a', '40d73530-1a6f-42c9-a968-3a81942da169', 'f161d467-be30-4373-b79a-7c58f8c1fc3f', '84b27201-dc18-4243-b5f5-61290bf59ab6'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:41 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a40e693f-c749-4353-9b32-0d7eeb6a53cc tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.294s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:41 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-a40e693f-c749-4353-9b32-0d7eeb6a53cc tempest-ProjectMemberTests-1072060943 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a40e693f-c749-4353-9b32-0d7eeb6a53cc tempest-ProjectMemberTests-1072060943 None] Deleted volume successfully. Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a40e693f-c749-4353-9b32-0d7eeb6a53cc tempest-ProjectMemberTests-1072060943 None] Lock "cinder-0d6fcb77-626a-4f2b-8700-cdbdb984753e-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:42 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.2a6c528b-43c1-4cb8-888d-cc09887b32fd" returned: 0 in 0.481s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.2a6c528b-43c1-4cb8-888d-cc09887b32fd {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4e4ebe1b-ecae-4782-a7e2-7c4beca428b9 tempest-ProjectReaderTests-963792890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4e4ebe1b-ecae-4782-a7e2-7c4beca428b9 tempest-ProjectReaderTests-963792890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4e4ebe1b-ecae-4782-a7e2-7c4beca428b9 tempest-ProjectReaderTests-963792890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:42 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.2a6c528b-43c1-4cb8-888d-cc09887b32fd Sep 01 12:24:42 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4e4ebe1b-ecae-4782-a7e2-7c4beca428b9 tempest-ProjectReaderTests-963792890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4e4ebe1b-ecae-4782-a7e2-7c4beca428b9 tempest-ProjectReaderTests-963792890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4e4ebe1b-ecae-4782-a7e2-7c4beca428b9 tempest-ProjectReaderTests-963792890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:42 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.281s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:42 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:24:42 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:24:42 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9.2a6c528b-43c1-4cb8-888d-cc09887b32fd" returned: 0 in 0.292s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-2a6c528b-43c1-4cb8-888d-cc09887b32fd" released by "_delete_snapshot" :: held 1.697s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-40470ab6-4a7e-41c1-8d45-8adbf6f739c9" released by "delete_snapshot" :: held 1.728s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:42 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4e4ebe1b-ecae-4782-a7e2-7c4beca428b9 tempest-ProjectReaderTests-963792890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.340s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-4e4ebe1b-ecae-4782-a7e2-7c4beca428b9 tempest-ProjectReaderTests-963792890 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:42 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4e4ebe1b-ecae-4782-a7e2-7c4beca428b9 tempest-ProjectReaderTests-963792890 None] Deleted volume successfully. Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Flow 'volume_create_manager' (eff93bfe-781f-48be-959d-dc4667071120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb21708f-0987-498d-acc6-ffd0c550fd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-4e4ebe1b-ecae-4782-a7e2-7c4beca428b9 tempest-ProjectReaderTests-963792890 None] Lock "cinder-1386441f-9311-42c2-8188-21d8c79660d9-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb21708f-0987-498d-acc6-ffd0c550fd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2109821141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a021cd18-777c-4655-ba01-4139fdeab243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f303c21f6004c3b8f3683085fa69682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:42Z,use_quota=True,user_id='6630d9cae50f4034a07faed651147f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f957ef8b-64e4-438a-9e7a-df5b6f62e2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f957ef8b-64e4-438a-9e7a-df5b6f62e2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea55b5a-e034-4d1e-8500-525b19b852ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea55b5a-e034-4d1e-8500-525b19b852ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a021cd18-777c-4655-ba01-4139fdeab243', 'volume_name': 'volume-a021cd18-777c-4655-ba01-4139fdeab243', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab6c80a-8096-4c07-a29e-a4a80aa9348a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab6c80a-8096-4c07-a29e-a4a80aa9348a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945d887c-86f8-4a08-b491-a08fe5190e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:42 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Volume a021cd18-777c-4655-ba01-4139fdeab243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a021cd18-777c-4655-ba01-4139fdeab243', 'volume_size': 1} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2109821141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a021cd18-777c-4655-ba01-4139fdeab243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f303c21f6004c3b8f3683085fa69682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:42Z,use_quota=True,user_id='6630d9cae50f4034a07faed651147f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Creating volume a021cd18-777c-4655-ba01-4139fdeab243 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:24:42 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:42 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243 1073741824 Sep 01 12:24:42 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] Created reservations ['f67e631d-4f26-4ecd-8987-d5559cf2ff2c', '1100b47b-c707-4c1f-9c48-7fe705b0abbf', 'ebf6b308-a87e-4464-a874-5f7da2f72e64', 'e2e63903-a095-4174-9bcd-f27bfc135265'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:42 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] Delete snapshot completed successfully. Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5e5fea51-e8d6-4414-bc34-cdd95cc31684 tempest-ProjectReaderTests-507375670 None] Lock "cinder-2a6c528b-43c1-4cb8-888d-cc09887b32fd-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-731a0aff-35e0-412a-ba89-0abb6c8131be tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-40470ab6-4a7e-41c1-8d45-8adbf6f739c9-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-731a0aff-35e0-412a-ba89-0abb6c8131be tempest-ProjectReaderTests-507375670 None] Lock "cinder-40470ab6-4a7e-41c1-8d45-8adbf6f739c9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Flow 'volume_create_manager' (4bf0b20b-ef26-4a71-b26c-4dee17861055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a54753-c040-49eb-b141-3bf1d92f6282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a54753-c040-49eb-b141-3bf1d92f6282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1467705118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d41b09-c52e-4a76-8f55-d035df3932b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d98b238068488682be67b2c48990b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:43Z,use_quota=True,user_id='ce6b871337cb4f498c62c04a0b07b1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b97fd9f2-d7d3-435f-b905-43ecd61b2f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b97fd9f2-d7d3-435f-b905-43ecd61b2f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304c6b81-7d84-4813-8d3a-d81569fb6ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304c6b81-7d84-4813-8d3a-d81569fb6ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9d41b09-c52e-4a76-8f55-d035df3932b8', 'volume_name': 'volume-f9d41b09-c52e-4a76-8f55-d035df3932b8', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f19202d-2879-405e-9bbe-8b3a0d810cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f19202d-2879-405e-9bbe-8b3a0d810cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d3c0d9a-789a-4b90-a36c-4222ec5b064c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:42 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Volume f9d41b09-c52e-4a76-8f55-d035df3932b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9d41b09-c52e-4a76-8f55-d035df3932b8', 'volume_size': 1} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-731a0aff-35e0-412a-ba89-0abb6c8131be tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-quobyte-40470ab6-4a7e-41c1-8d45-8adbf6f739c9" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-731a0aff-35e0-412a-ba89-0abb6c8131be tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-40470ab6-4a7e-41c1-8d45-8adbf6f739c9" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a342f2-59a2-4f18-9a66-7bae3604c80d]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-731a0aff-35e0-412a-ba89-0abb6c8131be tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:43 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243 1073741824" returned: 0 in 0.485s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:43 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9 Sep 01 12:24:43 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:43 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243 Sep 01 12:24:43 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:43 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:43 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243" returned: 0 in 0.253s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.439s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1467705118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d41b09-c52e-4a76-8f55-d035df3932b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d98b238068488682be67b2c48990b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:43Z,use_quota=True,user_id='ce6b871337cb4f498c62c04a0b07b1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Creating volume f9d41b09-c52e-4a76-8f55-d035df3932b8 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:24:43 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f9d41b09-c52e-4a76-8f55-d035df3932b8 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-731a0aff-35e0-412a-ba89-0abb6c8131be tempest-ProjectReaderTests-507375670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9" returned: 0 in 0.393s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-731a0aff-35e0-412a-ba89-0abb6c8131be tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:43 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f9d41b09-c52e-4a76-8f55-d035df3932b8 1073741824 Sep 01 12:24:43 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945d887c-86f8-4a08-b491-a08fe5190e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a021cd18-777c-4655-ba01-4139fdeab243', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81db6655-ad20-4035-8fc7-3a9f826e0f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:43 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9 Sep 01 12:24:43 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:43 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Volume volume-a021cd18-777c-4655-ba01-4139fdeab243 (a021cd18-777c-4655-ba01-4139fdeab243): created successfully Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81db6655-ad20-4035-8fc7-3a9f826e0f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Flow 'volume_create_manager' (eff93bfe-781f-48be-959d-dc4667071120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:43 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-16d875f9-e034-440e-8a16-c381273fa0cc tempest-ProjectMemberTests-1072060943 None] Created volume successfully. Sep 01 12:24:43 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-731a0aff-35e0-412a-ba89-0abb6c8131be tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-40470ab6-4a7e-41c1-8d45-8adbf6f739c9" returned: 0 in 0.261s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-731a0aff-35e0-412a-ba89-0abb6c8131be tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-40470ab6-4a7e-41c1-8d45-8adbf6f739c9" released by "delete_volume" :: held 0.712s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-731a0aff-35e0-412a-ba89-0abb6c8131be tempest-ProjectReaderTests-507375670 None] Created reservations ['9045cbdf-46c0-4572-91fb-d9702d379729', 'ceaa1ad2-4513-43b0-ad51-4dbcad73c95b', 'ed9293b7-2e1d-40bd-9585-9780c79d07fa', '6fe3e473-0727-429b-b899-80ab3814fdb6'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-731a0aff-35e0-412a-ba89-0abb6c8131be tempest-ProjectReaderTests-507375670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-731a0aff-35e0-412a-ba89-0abb6c8131be tempest-ProjectReaderTests-507375670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-731a0aff-35e0-412a-ba89-0abb6c8131be tempest-ProjectReaderTests-507375670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-731a0aff-35e0-412a-ba89-0abb6c8131be tempest-ProjectReaderTests-507375670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-731a0aff-35e0-412a-ba89-0abb6c8131be tempest-ProjectReaderTests-507375670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-731a0aff-35e0-412a-ba89-0abb6c8131be tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:43 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:43 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:43 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f9d41b09-c52e-4a76-8f55-d035df3932b8 1073741824" returned: 0 in 0.456s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f9d41b09-c52e-4a76-8f55-d035df3932b8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:43 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f9d41b09-c52e-4a76-8f55-d035df3932b8 Sep 01 12:24:43 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:43 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-731a0aff-35e0-412a-ba89-0abb6c8131be tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.249s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:43 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-731a0aff-35e0-412a-ba89-0abb6c8131be tempest-ProjectReaderTests-507375670 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:44 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-731a0aff-35e0-412a-ba89-0abb6c8131be tempest-ProjectReaderTests-507375670 None] Deleted volume successfully. Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-731a0aff-35e0-412a-ba89-0abb6c8131be tempest-ProjectReaderTests-507375670 None] Lock "cinder-40470ab6-4a7e-41c1-8d45-8adbf6f739c9-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:44 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f9d41b09-c52e-4a76-8f55-d035df3932b8" returned: 0 in 0.249s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d3c0d9a-789a-4b90-a36c-4222ec5b064c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9d41b09-c52e-4a76-8f55-d035df3932b8', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd2e8e9-b335-49d7-a44c-b4cad62f8686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:44 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Volume volume-f9d41b09-c52e-4a76-8f55-d035df3932b8 (f9d41b09-c52e-4a76-8f55-d035df3932b8): created successfully Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd2e8e9-b335-49d7-a44c-b4cad62f8686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Flow 'volume_create_manager' (4bf0b20b-ef26-4a71-b26c-4dee17861055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:44 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-122244ac-50a0-4328-8cc1-903fa296bdd2 tempest-ProjectReaderTests-963792890 None] Created volume successfully. Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Flow 'volume_create_manager' (3dc96e27-a63b-457a-9a15-62010f8b6264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a61d12-ca2d-4383-8913-e88bdf87b9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a61d12-ca2d-4383-8913-e88bdf87b9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1733916038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2e48e7-33f4-410a-b360-b93365caef0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554d1f313f4d41198140f854d4acc488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:44Z,use_quota=True,user_id='70a0758d24234e578aa505d1ca02821b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2278d1d0-676b-43ed-8891-cffb41da022b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2278d1d0-676b-43ed-8891-cffb41da022b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc723db-9110-4631-b69e-13266ee1d214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc723db-9110-4631-b69e-13266ee1d214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b2e48e7-33f4-410a-b360-b93365caef0e', 'volume_name': 'volume-5b2e48e7-33f4-410a-b360-b93365caef0e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16421418-d2b2-4415-a696-12e9830d085e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16421418-d2b2-4415-a696-12e9830d085e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637d6313-dd50-487c-b807-1cd30c9675ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:44 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Volume 5b2e48e7-33f4-410a-b360-b93365caef0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b2e48e7-33f4-410a-b360-b93365caef0e', 'volume_size': 1} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1733916038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2e48e7-33f4-410a-b360-b93365caef0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554d1f313f4d41198140f854d4acc488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:44Z,use_quota=True,user_id='70a0758d24234e578aa505d1ca02821b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Creating volume 5b2e48e7-33f4-410a-b360-b93365caef0e {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:24:44 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:44 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e 1073741824 Sep 01 12:24:44 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-76477551-b2fb-4297-93de-2bc3d709c85c tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:44 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e8e609d5-e39d-42ed-b6f7-4d44b58dba77 tempest-ProjectReaderTests-963792890 None] Acquiring lock "cinder-f9d41b09-c52e-4a76-8f55-d035df3932b8-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e 1073741824" returned: 0 in 0.479s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e8e609d5-e39d-42ed-b6f7-4d44b58dba77 tempest-ProjectReaderTests-963792890 None] Lock "cinder-f9d41b09-c52e-4a76-8f55-d035df3932b8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:44 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e8e609d5-e39d-42ed-b6f7-4d44b58dba77 tempest-ProjectReaderTests-963792890 None] Acquiring lock "cinder-quobyte-f9d41b09-c52e-4a76-8f55-d035df3932b8" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:45 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e Sep 01 12:24:45 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e8e609d5-e39d-42ed-b6f7-4d44b58dba77 tempest-ProjectReaderTests-963792890 None] Lock "cinder-quobyte-f9d41b09-c52e-4a76-8f55-d035df3932b8" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3696f6-6ce1-48ee-bfcb-c2fe1e1822ad]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e8e609d5-e39d-42ed-b6f7-4d44b58dba77 tempest-ProjectReaderTests-963792890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f9d41b09-c52e-4a76-8f55-d035df3932b8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:45 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f9d41b09-c52e-4a76-8f55-d035df3932b8 Sep 01 12:24:45 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:45 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e" returned: 0 in 0.245s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-76477551-b2fb-4297-93de-2bc3d709c85c tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.611s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637d6313-dd50-487c-b807-1cd30c9675ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b2e48e7-33f4-410a-b360-b93365caef0e', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e59ea0-60be-4980-8bea-443cb6d5336b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-76477551-b2fb-4297-93de-2bc3d709c85c tempest-ProjectMemberTests-1072060943 None] Creating offline snapshot 27300071-6ff7-43ca-83dc-ef79718b918f of volume a021cd18-777c-4655-ba01-4139fdeab243 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:24:45 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Volume volume-5b2e48e7-33f4-410a-b360-b93365caef0e (5b2e48e7-33f4-410a-b360-b93365caef0e): created successfully Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e59ea0-60be-4980-8bea-443cb6d5336b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Flow 'volume_create_manager' (3dc96e27-a63b-457a-9a15-62010f8b6264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4159a06d-04ef-48cd-a54a-384368968658]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-76477551-b2fb-4297-93de-2bc3d709c85c tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:45 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-03285b3a-dc8c-46dc-94ba-4b9d2fb550f7 tempest-ProjectReaderTests-507375670 None] Created volume successfully. Sep 01 12:24:45 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e8e609d5-e39d-42ed-b6f7-4d44b58dba77 tempest-ProjectReaderTests-963792890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f9d41b09-c52e-4a76-8f55-d035df3932b8" returned: 0 in 0.384s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e8e609d5-e39d-42ed-b6f7-4d44b58dba77 tempest-ProjectReaderTests-963792890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f9d41b09-c52e-4a76-8f55-d035df3932b8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:45 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243 Sep 01 12:24:45 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:45 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f9d41b09-c52e-4a76-8f55-d035df3932b8 Sep 01 12:24:45 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:45 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e8e609d5-e39d-42ed-b6f7-4d44b58dba77 tempest-ProjectReaderTests-963792890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-f9d41b09-c52e-4a76-8f55-d035df3932b8" returned: 0 in 0.250s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:45 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-76477551-b2fb-4297-93de-2bc3d709c85c tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243" returned: 0 in 0.378s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-76477551-b2fb-4297-93de-2bc3d709c85c tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.27300071-6ff7-43ca-83dc-ef79718b918f 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e8e609d5-e39d-42ed-b6f7-4d44b58dba77 tempest-ProjectReaderTests-963792890 None] Lock "cinder-quobyte-f9d41b09-c52e-4a76-8f55-d035df3932b8" released by "delete_volume" :: held 0.682s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:45 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.27300071-6ff7-43ca-83dc-ef79718b918f 1G Sep 01 12:24:45 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-e8e609d5-e39d-42ed-b6f7-4d44b58dba77 tempest-ProjectReaderTests-963792890 None] Created reservations ['a4a7cd93-d4d8-4709-9e73-b11f90c3d096', '55795f2a-7e19-4c83-a816-40f3c7c8357d', '8467e2a3-c4d2-46e0-9d88-5c4d84b6bafa', 'c5ec83f3-5f00-4fdc-9712-cb93256c0f5d'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e8e609d5-e39d-42ed-b6f7-4d44b58dba77 tempest-ProjectReaderTests-963792890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e8e609d5-e39d-42ed-b6f7-4d44b58dba77 tempest-ProjectReaderTests-963792890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e8e609d5-e39d-42ed-b6f7-4d44b58dba77 tempest-ProjectReaderTests-963792890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-e8e609d5-e39d-42ed-b6f7-4d44b58dba77 tempest-ProjectReaderTests-963792890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-e8e609d5-e39d-42ed-b6f7-4d44b58dba77 tempest-ProjectReaderTests-963792890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:45 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e8e609d5-e39d-42ed-b6f7-4d44b58dba77 tempest-ProjectReaderTests-963792890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:45 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:45 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:46 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-e8e609d5-e39d-42ed-b6f7-4d44b58dba77 tempest-ProjectReaderTests-963792890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.261s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:46 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-e8e609d5-e39d-42ed-b6f7-4d44b58dba77 tempest-ProjectReaderTests-963792890 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:46 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-e8e609d5-e39d-42ed-b6f7-4d44b58dba77 tempest-ProjectReaderTests-963792890 None] Deleted volume successfully. Sep 01 12:24:46 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-e8e609d5-e39d-42ed-b6f7-4d44b58dba77 tempest-ProjectReaderTests-963792890 None] Lock "cinder-f9d41b09-c52e-4a76-8f55-d035df3932b8-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:46 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-76477551-b2fb-4297-93de-2bc3d709c85c tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.27300071-6ff7-43ca-83dc-ef79718b918f 1G" returned: 0 in 0.464s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-76477551-b2fb-4297-93de-2bc3d709c85c tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a021cd18-777c-4655-ba01-4139fdeab243 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.27300071-6ff7-43ca-83dc-ef79718b918f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:46 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a021cd18-777c-4655-ba01-4139fdeab243 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.27300071-6ff7-43ca-83dc-ef79718b918f Sep 01 12:24:46 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:46 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-76477551-b2fb-4297-93de-2bc3d709c85c tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a021cd18-777c-4655-ba01-4139fdeab243 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.27300071-6ff7-43ca-83dc-ef79718b918f" returned: 0 in 0.344s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:46 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-76477551-b2fb-4297-93de-2bc3d709c85c tempest-ProjectMemberTests-1072060943 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.27300071-6ff7-43ca-83dc-ef79718b918f is being set with open permissions: ugo+rw Sep 01 12:24:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-76477551-b2fb-4297-93de-2bc3d709c85c tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.27300071-6ff7-43ca-83dc-ef79718b918f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:46 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.27300071-6ff7-43ca-83dc-ef79718b918f Sep 01 12:24:46 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7c6740d0-a819-4105-ab23-ff7b194d45ce tempest-ProjectReaderTests-507375670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:46 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-76477551-b2fb-4297-93de-2bc3d709c85c tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.27300071-6ff7-43ca-83dc-ef79718b918f" returned: 0 in 0.287s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:46 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-76477551-b2fb-4297-93de-2bc3d709c85c tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:46 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.info Sep 01 12:24:46 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:47 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-76477551-b2fb-4297-93de-2bc3d709c85c tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.info" returned: 0 in 0.256s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:47 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-76477551-b2fb-4297-93de-2bc3d709c85c tempest-ProjectMemberTests-1072060943 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.info is being set with open permissions: ugo+rw Sep 01 12:24:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-76477551-b2fb-4297-93de-2bc3d709c85c tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:47 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.info Sep 01 12:24:47 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:47 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-76477551-b2fb-4297-93de-2bc3d709c85c tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.info" returned: 0 in 0.255s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-76477551-b2fb-4297-93de-2bc3d709c85c tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.103s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7c6740d0-a819-4105-ab23-ff7b194d45ce tempest-ProjectReaderTests-507375670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.686s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7c6740d0-a819-4105-ab23-ff7b194d45ce tempest-ProjectReaderTests-507375670 None] Creating offline snapshot a3624695-8bbe-473f-89aa-2d46a994ea0c of volume 5b2e48e7-33f4-410a-b360-b93365caef0e {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:24:47 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-76477551-b2fb-4297-93de-2bc3d709c85c tempest-ProjectMemberTests-1072060943 None] Create snapshot completed successfully Sep 01 12:24:47 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[36459895-7d93-4931-a3f2-7033ea723863]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c6740d0-a819-4105-ab23-ff7b194d45ce tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:47 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e Sep 01 12:24:47 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:47 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c6740d0-a819-4105-ab23-ff7b194d45ce tempest-ProjectReaderTests-507375670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e" returned: 0 in 0.398s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c6740d0-a819-4105-ab23-ff7b194d45ce tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.a3624695-8bbe-473f-89aa-2d46a994ea0c 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-27300071-6ff7-43ca-83dc-ef79718b918f-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:47 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.a3624695-8bbe-473f-89aa-2d46a994ea0c 1G Sep 01 12:24:47 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] Lock "cinder-27300071-6ff7-43ca-83dc-ef79718b918f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-a021cd18-777c-4655-ba01-4139fdeab243" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-a021cd18-777c-4655-ba01-4139fdeab243" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-27300071-6ff7-43ca-83dc-ef79718b918f" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:47 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-27300071-6ff7-43ca-83dc-ef79718b918f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] Deleting offline snapshot 27300071-6ff7-43ca-83dc-ef79718b918f of volume a021cd18-777c-4655-ba01-4139fdeab243 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:24:47 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] snapshot_file for this snap is: volume-a021cd18-777c-4655-ba01-4139fdeab243.27300071-6ff7-43ca-83dc-ef79718b918f {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:24:47 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bb2437-8655-453b-bca8-8d23fdbdd345]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:47 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.27300071-6ff7-43ca-83dc-ef79718b918f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:48 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.27300071-6ff7-43ca-83dc-ef79718b918f Sep 01 12:24:48 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:48 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c6740d0-a819-4105-ab23-ff7b194d45ce tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.a3624695-8bbe-473f-89aa-2d46a994ea0c 1G" returned: 0 in 0.440s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c6740d0-a819-4105-ab23-ff7b194d45ce tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b2e48e7-33f4-410a-b360-b93365caef0e -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.a3624695-8bbe-473f-89aa-2d46a994ea0c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:48 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b2e48e7-33f4-410a-b360-b93365caef0e -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.a3624695-8bbe-473f-89aa-2d46a994ea0c Sep 01 12:24:48 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:48 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.27300071-6ff7-43ca-83dc-ef79718b918f" returned: 0 in 0.377s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:48 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a021cd18-777c-4655-ba01-4139fdeab243(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:24:48 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cf0627-f31a-41a1-ac18-7ea913a532e6]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:48 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243 Sep 01 12:24:48 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:48 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c6740d0-a819-4105-ab23-ff7b194d45ce tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b2e48e7-33f4-410a-b360-b93365caef0e -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.a3624695-8bbe-473f-89aa-2d46a994ea0c" returned: 0 in 0.300s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:48 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-7c6740d0-a819-4105-ab23-ff7b194d45ce tempest-ProjectReaderTests-507375670 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.a3624695-8bbe-473f-89aa-2d46a994ea0c is being set with open permissions: ugo+rw Sep 01 12:24:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c6740d0-a819-4105-ab23-ff7b194d45ce tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.a3624695-8bbe-473f-89aa-2d46a994ea0c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:48 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.a3624695-8bbe-473f-89aa-2d46a994ea0c Sep 01 12:24:48 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:48 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243" returned: 0 in 0.359s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.27300071-6ff7-43ca-83dc-ef79718b918f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:48 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.27300071-6ff7-43ca-83dc-ef79718b918f Sep 01 12:24:48 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:48 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c6740d0-a819-4105-ab23-ff7b194d45ce tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.a3624695-8bbe-473f-89aa-2d46a994ea0c" returned: 0 in 0.279s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:48 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c6740d0-a819-4105-ab23-ff7b194d45ce tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:48 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.info Sep 01 12:24:48 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:49 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c6740d0-a819-4105-ab23-ff7b194d45ce tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.info" returned: 0 in 0.260s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:49 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-7c6740d0-a819-4105-ab23-ff7b194d45ce tempest-ProjectReaderTests-507375670 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.info is being set with open permissions: ugo+rw Sep 01 12:24:49 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c6740d0-a819-4105-ab23-ff7b194d45ce tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.27300071-6ff7-43ca-83dc-ef79718b918f" returned: 0 in 0.397s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.27300071-6ff7-43ca-83dc-ef79718b918f {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:49 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.info Sep 01 12:24:49 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:49 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.27300071-6ff7-43ca-83dc-ef79718b918f Sep 01 12:24:49 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:49 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7c6740d0-a819-4105-ab23-ff7b194d45ce tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.info" returned: 0 in 0.245s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7c6740d0-a819-4105-ab23-ff7b194d45ce tempest-ProjectReaderTests-507375670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.018s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:49 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243.27300071-6ff7-43ca-83dc-ef79718b918f" returned: 0 in 0.271s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-27300071-6ff7-43ca-83dc-ef79718b918f" released by "_delete_snapshot" :: held 1.525s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-a021cd18-777c-4655-ba01-4139fdeab243" released by "delete_snapshot" :: held 1.549s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:49 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7c6740d0-a819-4105-ab23-ff7b194d45ce tempest-ProjectReaderTests-507375670 None] Create snapshot completed successfully Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] Created reservations ['48fb8e42-1ba1-4606-8acf-ca0072bf5e5e', '4958ce06-3807-47fa-9678-30c56abee9f2', '34d38208-d5fb-4209-af13-35934b85354d', '3bbd751b-3f87-4b0c-9af3-f58c5e269526'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:49 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] Delete snapshot completed successfully. Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2fb808b5-3dfc-4625-a5e6-48355c8b92da tempest-ProjectMemberTests-1072060943 None] Lock "cinder-27300071-6ff7-43ca-83dc-ef79718b918f-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-a3624695-8bbe-473f-89aa-2d46a994ea0c-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] Lock "cinder-a3624695-8bbe-473f-89aa-2d46a994ea0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-quobyte-5b2e48e7-33f4-410a-b360-b93365caef0e" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-5b2e48e7-33f4-410a-b360-b93365caef0e" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-quobyte-a3624695-8bbe-473f-89aa-2d46a994ea0c" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-a3624695-8bbe-473f-89aa-2d46a994ea0c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] Deleting offline snapshot a3624695-8bbe-473f-89aa-2d46a994ea0c of volume 5b2e48e7-33f4-410a-b360-b93365caef0e {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] snapshot_file for this snap is: volume-5b2e48e7-33f4-410a-b360-b93365caef0e.a3624695-8bbe-473f-89aa-2d46a994ea0c {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[28532340-d35e-4e04-ba86-114410cca411]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.a3624695-8bbe-473f-89aa-2d46a994ea0c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:49 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-863d36df-edd2-4680-b4e4-b14dfaea96d6 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-a021cd18-777c-4655-ba01-4139fdeab243-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:50 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.a3624695-8bbe-473f-89aa-2d46a994ea0c Sep 01 12:24:50 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-863d36df-edd2-4680-b4e4-b14dfaea96d6 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-a021cd18-777c-4655-ba01-4139fdeab243-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-863d36df-edd2-4680-b4e4-b14dfaea96d6 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-a021cd18-777c-4655-ba01-4139fdeab243" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-863d36df-edd2-4680-b4e4-b14dfaea96d6 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-a021cd18-777c-4655-ba01-4139fdeab243" acquired by "delete_volume" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f369e0ac-c2a8-4b1a-8363-567fec553b96]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-863d36df-edd2-4680-b4e4-b14dfaea96d6 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:50 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243 Sep 01 12:24:50 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:50 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.a3624695-8bbe-473f-89aa-2d46a994ea0c" returned: 0 in 0.377s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b2e48e7-33f4-410a-b360-b93365caef0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[234f3431-eda9-4500-b5cc-c97bd2b340f7]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:50 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e Sep 01 12:24:50 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:50 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-863d36df-edd2-4680-b4e4-b14dfaea96d6 tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243" returned: 0 in 0.362s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-863d36df-edd2-4680-b4e4-b14dfaea96d6 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:50 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243 Sep 01 12:24:50 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:50 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e" returned: 0 in 0.364s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.a3624695-8bbe-473f-89aa-2d46a994ea0c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:50 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.a3624695-8bbe-473f-89aa-2d46a994ea0c Sep 01 12:24:50 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:50 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-863d36df-edd2-4680-b4e4-b14dfaea96d6 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a021cd18-777c-4655-ba01-4139fdeab243" returned: 0 in 0.249s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-863d36df-edd2-4680-b4e4-b14dfaea96d6 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-a021cd18-777c-4655-ba01-4139fdeab243" released by "delete_volume" :: held 0.674s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-863d36df-edd2-4680-b4e4-b14dfaea96d6 tempest-ProjectMemberTests-1072060943 None] Created reservations ['3b307614-80fa-4b50-a41c-8be94388cd92', '98cb662b-d5db-4d5c-9c3b-21f32a7fbd79', '89332d36-5a73-4a2a-b172-e831a3588168', 'da0a2152-7b67-436e-a79f-d0161ddf5acb'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-863d36df-edd2-4680-b4e4-b14dfaea96d6 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-863d36df-edd2-4680-b4e4-b14dfaea96d6 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-863d36df-edd2-4680-b4e4-b14dfaea96d6 tempest-ProjectMemberTests-1072060943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-863d36df-edd2-4680-b4e4-b14dfaea96d6 tempest-ProjectMemberTests-1072060943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-863d36df-edd2-4680-b4e4-b14dfaea96d6 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:50 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-863d36df-edd2-4680-b4e4-b14dfaea96d6 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:50 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:50 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:51 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.a3624695-8bbe-473f-89aa-2d46a994ea0c" returned: 0 in 0.359s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.a3624695-8bbe-473f-89aa-2d46a994ea0c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:51 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.a3624695-8bbe-473f-89aa-2d46a994ea0c Sep 01 12:24:51 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:51 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-863d36df-edd2-4680-b4e4-b14dfaea96d6 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.276s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-863d36df-edd2-4680-b4e4-b14dfaea96d6 tempest-ProjectMemberTests-1072060943 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:51 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-863d36df-edd2-4680-b4e4-b14dfaea96d6 tempest-ProjectMemberTests-1072060943 None] Deleted volume successfully. Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-863d36df-edd2-4680-b4e4-b14dfaea96d6 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-a021cd18-777c-4655-ba01-4139fdeab243-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:51 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e.a3624695-8bbe-473f-89aa-2d46a994ea0c" returned: 0 in 0.283s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-a3624695-8bbe-473f-89aa-2d46a994ea0c" released by "_delete_snapshot" :: held 1.476s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-5b2e48e7-33f4-410a-b360-b93365caef0e" released by "delete_snapshot" :: held 1.497s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] Created reservations ['db33319f-691b-4275-a550-36b43a4c00fd', '866eaad1-17b3-40a3-bca6-57ec5f3db25c', '36dc32e4-aac7-429a-952a-945f9f6d4b97', 'd7e156c8-c266-4bd9-987f-dd89815804c8'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:51 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] Delete snapshot completed successfully. Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2c795f91-da21-4978-a4ca-76d2d11e95cf tempest-ProjectReaderTests-507375670 None] Lock "cinder-a3624695-8bbe-473f-89aa-2d46a994ea0c-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Flow 'volume_create_manager' (75566dbb-95cd-4365-99f8-55fa1c381b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766f5f4c-ee61-44d0-b4ee-72d6b2085823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766f5f4c-ee61-44d0-b4ee-72d6b2085823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1316219691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63d223c-20a1-4c76-bed5-5dcf1f8e0f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f303c21f6004c3b8f3683085fa69682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:52Z,use_quota=True,user_id='6630d9cae50f4034a07faed651147f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8f34b0-20fd-4a1b-abd9-22df0c64a4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8f34b0-20fd-4a1b-abd9-22df0c64a4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c20d0d-2629-4ecd-b4ba-e9272fded91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c20d0d-2629-4ecd-b4ba-e9272fded91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b63d223c-20a1-4c76-bed5-5dcf1f8e0f97', 'volume_name': 'volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cbf4750-ca46-43af-b26d-bed75ba9505d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cbf4750-ca46-43af-b26d-bed75ba9505d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29cd01b6-a986-4c05-8473-b03b3b2c318a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:51 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Volume b63d223c-20a1-4c76-bed5-5dcf1f8e0f97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97', 'volume_size': 1} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1316219691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63d223c-20a1-4c76-bed5-5dcf1f8e0f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f303c21f6004c3b8f3683085fa69682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:52Z,use_quota=True,user_id='6630d9cae50f4034a07faed651147f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Creating volume b63d223c-20a1-4c76-bed5-5dcf1f8e0f97 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:24:51 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:51 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97 1073741824 Sep 01 12:24:51 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:51 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2e77dafb-086c-4a8e-99ff-be919c81f7e7 tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-5b2e48e7-33f4-410a-b360-b93365caef0e-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2e77dafb-086c-4a8e-99ff-be919c81f7e7 tempest-ProjectReaderTests-507375670 None] Lock "cinder-5b2e48e7-33f4-410a-b360-b93365caef0e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2e77dafb-086c-4a8e-99ff-be919c81f7e7 tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-quobyte-5b2e48e7-33f4-410a-b360-b93365caef0e" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2e77dafb-086c-4a8e-99ff-be919c81f7e7 tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-5b2e48e7-33f4-410a-b360-b93365caef0e" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d718bbb1-3fe1-4e19-8ffa-31ff7dda42ad]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2e77dafb-086c-4a8e-99ff-be919c81f7e7 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:52 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97 1073741824" returned: 0 in 0.513s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:52 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e Sep 01 12:24:52 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:52 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97 Sep 01 12:24:52 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:52 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2e77dafb-086c-4a8e-99ff-be919c81f7e7 tempest-ProjectReaderTests-507375670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e" returned: 0 in 0.409s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2e77dafb-086c-4a8e-99ff-be919c81f7e7 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:52 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97" returned: 0 in 0.257s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:52 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e Sep 01 12:24:52 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29cd01b6-a986-4c05-8473-b03b3b2c318a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd04908e-0196-4c4e-9a15-87d05e700935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:52 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Volume volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97 (b63d223c-20a1-4c76-bed5-5dcf1f8e0f97): created successfully Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd04908e-0196-4c4e-9a15-87d05e700935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Flow 'volume_create_manager' (75566dbb-95cd-4365-99f8-55fa1c381b08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:52 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-68ec1069-6b9a-4ae2-80b7-162f08fd0e65 tempest-ProjectMemberTests-1072060943 None] Created volume successfully. Sep 01 12:24:52 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2e77dafb-086c-4a8e-99ff-be919c81f7e7 tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5b2e48e7-33f4-410a-b360-b93365caef0e" returned: 0 in 0.256s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2e77dafb-086c-4a8e-99ff-be919c81f7e7 tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-5b2e48e7-33f4-410a-b360-b93365caef0e" released by "delete_volume" :: held 0.721s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-2e77dafb-086c-4a8e-99ff-be919c81f7e7 tempest-ProjectReaderTests-507375670 None] Created reservations ['de91ad09-a826-4e69-bb77-6a12d35cac90', '4be25895-4a72-4060-bdfb-274346c1ff27', 'd8e3a6b3-a3a7-480e-b561-6cfc3b521c74', '9e4044bd-4672-4a36-8a61-243b09468f37'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2e77dafb-086c-4a8e-99ff-be919c81f7e7 tempest-ProjectReaderTests-507375670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2e77dafb-086c-4a8e-99ff-be919c81f7e7 tempest-ProjectReaderTests-507375670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2e77dafb-086c-4a8e-99ff-be919c81f7e7 tempest-ProjectReaderTests-507375670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2e77dafb-086c-4a8e-99ff-be919c81f7e7 tempest-ProjectReaderTests-507375670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2e77dafb-086c-4a8e-99ff-be919c81f7e7 tempest-ProjectReaderTests-507375670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:52 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2e77dafb-086c-4a8e-99ff-be919c81f7e7 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:52 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:24:52 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:53 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2e77dafb-086c-4a8e-99ff-be919c81f7e7 tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.259s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-2e77dafb-086c-4a8e-99ff-be919c81f7e7 tempest-ProjectReaderTests-507375670 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:24:53 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2e77dafb-086c-4a8e-99ff-be919c81f7e7 tempest-ProjectReaderTests-507375670 None] Deleted volume successfully. Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2e77dafb-086c-4a8e-99ff-be919c81f7e7 tempest-ProjectReaderTests-507375670 None] Lock "cinder-5b2e48e7-33f4-410a-b360-b93365caef0e-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Flow 'volume_create_manager' (d4668cf5-afc4-4d59-be4f-580b0e2c4c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3332f363-24a2-4c2a-86b7-883ad06b0ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3332f363-24a2-4c2a-86b7-883ad06b0ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-552862491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e40fbb-08ce-4acc-a687-db4e839c2197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554d1f313f4d41198140f854d4acc488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:54Z,use_quota=True,user_id='70a0758d24234e578aa505d1ca02821b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ab306c-94c3-4ef3-9c78-06c08c126ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ab306c-94c3-4ef3-9c78-06c08c126ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf458a5-5b34-4c67-8060-dd8f7bc28bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf458a5-5b34-4c67-8060-dd8f7bc28bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66e40fbb-08ce-4acc-a687-db4e839c2197', 'volume_name': 'volume-66e40fbb-08ce-4acc-a687-db4e839c2197', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d17678-8d78-49aa-8c14-835fc37b74dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d17678-8d78-49aa-8c14-835fc37b74dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a65253-bf8e-4b18-b391-380d8239e655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:53 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Volume 66e40fbb-08ce-4acc-a687-db4e839c2197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66e40fbb-08ce-4acc-a687-db4e839c2197', 'volume_size': 1} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-552862491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e40fbb-08ce-4acc-a687-db4e839c2197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554d1f313f4d41198140f854d4acc488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:24:54Z,use_quota=True,user_id='70a0758d24234e578aa505d1ca02821b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Creating volume 66e40fbb-08ce-4acc-a687-db4e839c2197 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:24:53 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:53 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197 1073741824 Sep 01 12:24:53 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:53 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a8c9445f-a3eb-4c9d-acc6-79bdfd31832c tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:54 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197 1073741824" returned: 0 in 0.424s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:54 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197 Sep 01 12:24:54 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:54 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197" returned: 0 in 0.239s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:24:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a8c9445f-a3eb-4c9d-acc6-79bdfd31832c tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.485s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a65253-bf8e-4b18-b391-380d8239e655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66e40fbb-08ce-4acc-a687-db4e839c2197', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd2848a-5304-4c86-9b7c-94b5f8214678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:24:54 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a8c9445f-a3eb-4c9d-acc6-79bdfd31832c tempest-ProjectMemberTests-1072060943 None] Creating offline snapshot c9ae845f-a650-458f-9704-fc1e9446f181 of volume b63d223c-20a1-4c76-bed5-5dcf1f8e0f97 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:24:54 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Volume volume-66e40fbb-08ce-4acc-a687-db4e839c2197 (66e40fbb-08ce-4acc-a687-db4e839c2197): created successfully Sep 01 12:24:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd2848a-5304-4c86-9b7c-94b5f8214678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:24:54 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Flow 'volume_create_manager' (d4668cf5-afc4-4d59-be4f-580b0e2c4c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:24:54 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3881dd7-42bd-4774-ad1f-90ec396ee6d9]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8c9445f-a3eb-4c9d-acc6-79bdfd31832c tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:54 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-db15932d-d23c-4246-99b4-15c869791e06 tempest-ProjectReaderTests-507375670 None] Created volume successfully. Sep 01 12:24:54 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97 Sep 01 12:24:54 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:54 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8c9445f-a3eb-4c9d-acc6-79bdfd31832c tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97" returned: 0 in 0.379s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8c9445f-a3eb-4c9d-acc6-79bdfd31832c tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.c9ae845f-a650-458f-9704-fc1e9446f181 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:54 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-20ce5c7f-3217-4cc1-8214-d7485235f653 tempest-ProjectReaderTests-507375670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:24:54 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.c9ae845f-a650-458f-9704-fc1e9446f181 1G Sep 01 12:24:54 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:55 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8c9445f-a3eb-4c9d-acc6-79bdfd31832c tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.c9ae845f-a650-458f-9704-fc1e9446f181 1G" returned: 0 in 0.389s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8c9445f-a3eb-4c9d-acc6-79bdfd31832c tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.c9ae845f-a650-458f-9704-fc1e9446f181 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:55 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.c9ae845f-a650-458f-9704-fc1e9446f181 Sep 01 12:24:55 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:55 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8c9445f-a3eb-4c9d-acc6-79bdfd31832c tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.c9ae845f-a650-458f-9704-fc1e9446f181" returned: 0 in 0.277s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:55 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-a8c9445f-a3eb-4c9d-acc6-79bdfd31832c tempest-ProjectMemberTests-1072060943 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.c9ae845f-a650-458f-9704-fc1e9446f181 is being set with open permissions: ugo+rw Sep 01 12:24:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8c9445f-a3eb-4c9d-acc6-79bdfd31832c tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.c9ae845f-a650-458f-9704-fc1e9446f181 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:55 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.c9ae845f-a650-458f-9704-fc1e9446f181 Sep 01 12:24:55 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:55 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8c9445f-a3eb-4c9d-acc6-79bdfd31832c tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.c9ae845f-a650-458f-9704-fc1e9446f181" returned: 0 in 0.251s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:55 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8c9445f-a3eb-4c9d-acc6-79bdfd31832c tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:55 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.info Sep 01 12:24:55 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:56 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8c9445f-a3eb-4c9d-acc6-79bdfd31832c tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.info" returned: 0 in 0.260s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:56 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-a8c9445f-a3eb-4c9d-acc6-79bdfd31832c tempest-ProjectMemberTests-1072060943 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.info is being set with open permissions: ugo+rw Sep 01 12:24:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8c9445f-a3eb-4c9d-acc6-79bdfd31832c tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:56 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.info Sep 01 12:24:56 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:56 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8c9445f-a3eb-4c9d-acc6-79bdfd31832c tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.info" returned: 0 in 0.245s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a8c9445f-a3eb-4c9d-acc6-79bdfd31832c tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.908s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-20ce5c7f-3217-4cc1-8214-d7485235f653 tempest-ProjectReaderTests-507375670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.457s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:24:56 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-20ce5c7f-3217-4cc1-8214-d7485235f653 tempest-ProjectReaderTests-507375670 None] Creating offline snapshot 78476bd0-ee98-400b-9c14-8451f17cb6ab of volume 66e40fbb-08ce-4acc-a687-db4e839c2197 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:24:56 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a8c9445f-a3eb-4c9d-acc6-79bdfd31832c tempest-ProjectMemberTests-1072060943 None] Create snapshot completed successfully Sep 01 12:24:56 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[69479abc-e1da-4597-bced-43651c7886ef]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20ce5c7f-3217-4cc1-8214-d7485235f653 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:56 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197 Sep 01 12:24:56 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:56 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20ce5c7f-3217-4cc1-8214-d7485235f653 tempest-ProjectReaderTests-507375670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197" returned: 0 in 0.351s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:56 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20ce5c7f-3217-4cc1-8214-d7485235f653 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.78476bd0-ee98-400b-9c14-8451f17cb6ab 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:56 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.78476bd0-ee98-400b-9c14-8451f17cb6ab 1G Sep 01 12:24:56 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-c9ae845f-a650-458f-9704-fc1e9446f181-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-c9ae845f-a650-458f-9704-fc1e9446f181-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:57 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20ce5c7f-3217-4cc1-8214-d7485235f653 tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.78476bd0-ee98-400b-9c14-8451f17cb6ab 1G" returned: 0 in 0.427s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20ce5c7f-3217-4cc1-8214-d7485235f653 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66e40fbb-08ce-4acc-a687-db4e839c2197 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.78476bd0-ee98-400b-9c14-8451f17cb6ab {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-c9ae845f-a650-458f-9704-fc1e9446f181" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:57 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66e40fbb-08ce-4acc-a687-db4e839c2197 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.78476bd0-ee98-400b-9c14-8451f17cb6ab Sep 01 12:24:57 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-c9ae845f-a650-458f-9704-fc1e9446f181" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] Deleting offline snapshot c9ae845f-a650-458f-9704-fc1e9446f181 of volume b63d223c-20a1-4c76-bed5-5dcf1f8e0f97 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] snapshot_file for this snap is: volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.c9ae845f-a650-458f-9704-fc1e9446f181 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1f3284-e859-44c0-bebf-e6d84891d3e4]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.c9ae845f-a650-458f-9704-fc1e9446f181 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:57 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.c9ae845f-a650-458f-9704-fc1e9446f181 Sep 01 12:24:57 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:57 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20ce5c7f-3217-4cc1-8214-d7485235f653 tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66e40fbb-08ce-4acc-a687-db4e839c2197 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.78476bd0-ee98-400b-9c14-8451f17cb6ab" returned: 0 in 0.291s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:57 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-20ce5c7f-3217-4cc1-8214-d7485235f653 tempest-ProjectReaderTests-507375670 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.78476bd0-ee98-400b-9c14-8451f17cb6ab is being set with open permissions: ugo+rw Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20ce5c7f-3217-4cc1-8214-d7485235f653 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.78476bd0-ee98-400b-9c14-8451f17cb6ab {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:57 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.78476bd0-ee98-400b-9c14-8451f17cb6ab Sep 01 12:24:57 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:57 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.c9ae845f-a650-458f-9704-fc1e9446f181" returned: 0 in 0.354s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[6775a0de-57b3-4fe6-bd1e-2a9ca8613477]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:57 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20ce5c7f-3217-4cc1-8214-d7485235f653 tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.78476bd0-ee98-400b-9c14-8451f17cb6ab" returned: 0 in 0.245s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:57 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97 Sep 01 12:24:57 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20ce5c7f-3217-4cc1-8214-d7485235f653 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:57 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.info Sep 01 12:24:57 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:57 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97" returned: 0 in 0.376s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:57 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.c9ae845f-a650-458f-9704-fc1e9446f181 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20ce5c7f-3217-4cc1-8214-d7485235f653 tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.info" returned: 0 in 0.268s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:57 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-20ce5c7f-3217-4cc1-8214-d7485235f653 tempest-ProjectReaderTests-507375670 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.info is being set with open permissions: ugo+rw Sep 01 12:24:57 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20ce5c7f-3217-4cc1-8214-d7485235f653 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:57 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.c9ae845f-a650-458f-9704-fc1e9446f181 Sep 01 12:24:57 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:57 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.info Sep 01 12:24:57 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:58 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-20ce5c7f-3217-4cc1-8214-d7485235f653 tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.info" returned: 0 in 0.244s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-20ce5c7f-3217-4cc1-8214-d7485235f653 tempest-ProjectReaderTests-507375670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:24:58 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-20ce5c7f-3217-4cc1-8214-d7485235f653 tempest-ProjectReaderTests-507375670 None] Create snapshot completed successfully Sep 01 12:24:58 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.c9ae845f-a650-458f-9704-fc1e9446f181" returned: 0 in 0.350s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.c9ae845f-a650-458f-9704-fc1e9446f181 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:58 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.c9ae845f-a650-458f-9704-fc1e9446f181 Sep 01 12:24:58 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:58 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:58 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97.c9ae845f-a650-458f-9704-fc1e9446f181" returned: 0 in 0.237s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-c9ae845f-a650-458f-9704-fc1e9446f181" released by "_delete_snapshot" :: held 1.407s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97" released by "delete_snapshot" :: held 1.433s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:58 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] Created reservations ['9c894b4f-975f-4bf7-b8c1-e86f94b63d1b', '5c7b7f2f-202e-400e-91cc-ce382deaea46', '5c8afecd-d2bf-4514-94fc-d768f7fdc20b', '0554aae1-5e23-46c0-8ba2-39b77bdb9646'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:24:58 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] Delete snapshot completed successfully. Sep 01 12:24:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-873c33dd-b381-49d4-99f6-392fd796d9b6 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-c9ae845f-a650-458f-9704-fc1e9446f181-delete_snapshot" released by "delete_snapshot" :: held 1.562s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:24:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-78476bd0-ee98-400b-9c14-8451f17cb6ab-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] Lock "cinder-78476bd0-ee98-400b-9c14-8451f17cb6ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-quobyte-66e40fbb-08ce-4acc-a687-db4e839c2197" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-66e40fbb-08ce-4acc-a687-db4e839c2197" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-quobyte-78476bd0-ee98-400b-9c14-8451f17cb6ab" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:58 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-78476bd0-ee98-400b-9c14-8451f17cb6ab" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:58 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] Deleting offline snapshot 78476bd0-ee98-400b-9c14-8451f17cb6ab of volume 66e40fbb-08ce-4acc-a687-db4e839c2197 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:24:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] snapshot_file for this snap is: volume-66e40fbb-08ce-4acc-a687-db4e839c2197.78476bd0-ee98-400b-9c14-8451f17cb6ab {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:24:59 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[9743fb23-a9b6-41f2-adba-fff592ef259c]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.78476bd0-ee98-400b-9c14-8451f17cb6ab {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:59 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.78476bd0-ee98-400b-9c14-8451f17cb6ab Sep 01 12:24:59 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-83ff8e6b-4ab6-4eb6-b499-e37a30d53fbd tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-83ff8e6b-4ab6-4eb6-b499-e37a30d53fbd tempest-ProjectMemberTests-1072060943 None] Lock "cinder-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-83ff8e6b-4ab6-4eb6-b499-e37a30d53fbd tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:24:59 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-83ff8e6b-4ab6-4eb6-b499-e37a30d53fbd tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97" acquired by "delete_volume" :: waited 0.023s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:24:59 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba045f54-7a8e-49b9-bc73-c70c926cb270]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-83ff8e6b-4ab6-4eb6-b499-e37a30d53fbd tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:59 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.78476bd0-ee98-400b-9c14-8451f17cb6ab" returned: 0 in 0.372s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:59 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66e40fbb-08ce-4acc-a687-db4e839c2197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:24:59 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7df3de-9d4f-4271-9b55-1bfca8799591]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:24:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:59 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97 Sep 01 12:24:59 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:59 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197 Sep 01 12:24:59 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:59 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-83ff8e6b-4ab6-4eb6-b499-e37a30d53fbd tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97" returned: 0 in 0.347s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-83ff8e6b-4ab6-4eb6-b499-e37a30d53fbd tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:59 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97 Sep 01 12:24:59 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:59 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197" returned: 0 in 0.350s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:24:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.78476bd0-ee98-400b-9c14-8451f17cb6ab {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:24:59 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.78476bd0-ee98-400b-9c14-8451f17cb6ab Sep 01 12:24:59 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:24:59 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Sep 01 12:24:59 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-83ff8e6b-4ab6-4eb6-b499-e37a30d53fbd tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97" returned: 0 in 0.267s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-83ff8e6b-4ab6-4eb6-b499-e37a30d53fbd tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97" released by "delete_volume" :: held 0.678s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-83ff8e6b-4ab6-4eb6-b499-e37a30d53fbd tempest-ProjectMemberTests-1072060943 None] Created reservations ['8dfc0566-54e3-4bf3-b7bf-025c88707da7', 'f8a5a10a-af75-4945-b0eb-d0ea19fe368c', 'ceda047f-1886-4c70-81d7-8306a6a5fb1b', '92c918d2-376c-4faf-bc92-feb912d6cee2'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-83ff8e6b-4ab6-4eb6-b499-e37a30d53fbd tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-83ff8e6b-4ab6-4eb6-b499-e37a30d53fbd tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-83ff8e6b-4ab6-4eb6-b499-e37a30d53fbd tempest-ProjectMemberTests-1072060943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-83ff8e6b-4ab6-4eb6-b499-e37a30d53fbd tempest-ProjectMemberTests-1072060943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-83ff8e6b-4ab6-4eb6-b499-e37a30d53fbd tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-83ff8e6b-4ab6-4eb6-b499-e37a30d53fbd tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:00 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.78476bd0-ee98-400b-9c14-8451f17cb6ab" returned: 0 in 0.372s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.78476bd0-ee98-400b-9c14-8451f17cb6ab {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:00 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:25:00 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:00 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.78476bd0-ee98-400b-9c14-8451f17cb6ab Sep 01 12:25:00 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:00 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-83ff8e6b-4ab6-4eb6-b499-e37a30d53fbd tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.258s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:00 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-83ff8e6b-4ab6-4eb6-b499-e37a30d53fbd tempest-ProjectMemberTests-1072060943 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197.78476bd0-ee98-400b-9c14-8451f17cb6ab" returned: 0 in 0.246s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:00 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-83ff8e6b-4ab6-4eb6-b499-e37a30d53fbd tempest-ProjectMemberTests-1072060943 None] Deleted volume successfully. Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-78476bd0-ee98-400b-9c14-8451f17cb6ab" released by "_delete_snapshot" :: held 1.442s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-66e40fbb-08ce-4acc-a687-db4e839c2197" released by "delete_snapshot" :: held 1.469s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-83ff8e6b-4ab6-4eb6-b499-e37a30d53fbd tempest-ProjectMemberTests-1072060943 None] Lock "cinder-b63d223c-20a1-4c76-bed5-5dcf1f8e0f97-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] Created reservations ['2d34cf33-b888-4f39-a996-58b5a43bf3f2', '9b56801a-00d0-40c2-b3ec-8d6a7b21aa8b', '8e8b8499-4e11-47c9-80a3-370e19ff21c4', '60b1b134-7075-47fb-b535-dd32704cdc69'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:25:00 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] Delete snapshot completed successfully. Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-06c465ea-6db5-400f-8b7c-cba8d3695f2e tempest-ProjectReaderTests-507375670 None] Lock "cinder-78476bd0-ee98-400b-9c14-8451f17cb6ab-delete_snapshot" released by "delete_snapshot" :: held 1.604s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Flow 'volume_create_manager' (36629401-2c08-4f62-8d7c-d3f19bebd7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b666f2-2319-4348-afd2-fe51e810907f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b666f2-2319-4348-afd2-fe51e810907f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-195160950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df6c17a-2c28-4d35-9cbb-05d327c06965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f303c21f6004c3b8f3683085fa69682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:25:01Z,use_quota=True,user_id='6630d9cae50f4034a07faed651147f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c16d53f-2935-475b-af94-f2fdc2344c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c16d53f-2935-475b-af94-f2fdc2344c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f79c42c-8788-4979-8161-fc73e307d6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f79c42c-8788-4979-8161-fc73e307d6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0df6c17a-2c28-4d35-9cbb-05d327c06965', 'volume_name': 'volume-0df6c17a-2c28-4d35-9cbb-05d327c06965', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb978901-cda2-4322-81c1-f9edb2ae96f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb978901-cda2-4322-81c1-f9edb2ae96f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618031fb-fa8a-4a2d-8116-97616b53416e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:00 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Volume 0df6c17a-2c28-4d35-9cbb-05d327c06965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0df6c17a-2c28-4d35-9cbb-05d327c06965', 'volume_size': 1} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-195160950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df6c17a-2c28-4d35-9cbb-05d327c06965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f303c21f6004c3b8f3683085fa69682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:25:01Z,use_quota=True,user_id='6630d9cae50f4034a07faed651147f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Creating volume 0df6c17a-2c28-4d35-9cbb-05d327c06965 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:25:00 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:25:00 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:00 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965 1073741824 Sep 01 12:25:00 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c97689bf-1b81-41ea-b54e-89a6e50d6bbf tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-66e40fbb-08ce-4acc-a687-db4e839c2197-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c97689bf-1b81-41ea-b54e-89a6e50d6bbf tempest-ProjectReaderTests-507375670 None] Lock "cinder-66e40fbb-08ce-4acc-a687-db4e839c2197-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c97689bf-1b81-41ea-b54e-89a6e50d6bbf tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-quobyte-66e40fbb-08ce-4acc-a687-db4e839c2197" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c97689bf-1b81-41ea-b54e-89a6e50d6bbf tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-66e40fbb-08ce-4acc-a687-db4e839c2197" acquired by "delete_volume" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:01 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf8c040-fc4c-4465-9df6-ba2df9e2fa24]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c97689bf-1b81-41ea-b54e-89a6e50d6bbf tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:01 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197 Sep 01 12:25:01 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:01 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965 1073741824" returned: 0 in 0.433s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:01 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965 Sep 01 12:25:01 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:01 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c97689bf-1b81-41ea-b54e-89a6e50d6bbf tempest-ProjectReaderTests-507375670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197" returned: 0 in 0.380s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c97689bf-1b81-41ea-b54e-89a6e50d6bbf tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:01 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197 Sep 01 12:25:01 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:01 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965" returned: 0 in 0.256s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:01 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:25:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618031fb-fa8a-4a2d-8116-97616b53416e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0df6c17a-2c28-4d35-9cbb-05d327c06965', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72e5ef2-d3e3-459e-9e26-34d131a56d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:01 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Volume volume-0df6c17a-2c28-4d35-9cbb-05d327c06965 (0df6c17a-2c28-4d35-9cbb-05d327c06965): created successfully Sep 01 12:25:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72e5ef2-d3e3-459e-9e26-34d131a56d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:01 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Flow 'volume_create_manager' (36629401-2c08-4f62-8d7c-d3f19bebd7ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:25:01 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1ab5e9a5-4ffc-417d-8213-a85de426a237 tempest-ProjectMemberTests-1072060943 None] Created volume successfully. Sep 01 12:25:01 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:01 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c97689bf-1b81-41ea-b54e-89a6e50d6bbf tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-66e40fbb-08ce-4acc-a687-db4e839c2197" returned: 0 in 0.266s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:01 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c97689bf-1b81-41ea-b54e-89a6e50d6bbf tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-66e40fbb-08ce-4acc-a687-db4e839c2197" released by "delete_volume" :: held 0.704s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:01 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c97689bf-1b81-41ea-b54e-89a6e50d6bbf tempest-ProjectReaderTests-507375670 None] Created reservations ['7a84eb2f-dc80-4ad6-8e8a-1db6de7a1dfb', '00a7a2c9-36af-4332-a64d-70b4c0538958', '8e917235-39fb-4f74-8320-c9a43e6886bd', 'bf0046d6-c02f-49a0-8b7e-2c97dfbaf75f'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c97689bf-1b81-41ea-b54e-89a6e50d6bbf tempest-ProjectReaderTests-507375670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c97689bf-1b81-41ea-b54e-89a6e50d6bbf tempest-ProjectReaderTests-507375670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c97689bf-1b81-41ea-b54e-89a6e50d6bbf tempest-ProjectReaderTests-507375670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c97689bf-1b81-41ea-b54e-89a6e50d6bbf tempest-ProjectReaderTests-507375670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c97689bf-1b81-41ea-b54e-89a6e50d6bbf tempest-ProjectReaderTests-507375670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c97689bf-1b81-41ea-b54e-89a6e50d6bbf tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:02 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:25:02 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4dc09c7b-5622-4696-a983-cb046ac57313 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4dc09c7b-5622-4696-a983-cb046ac57313 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4dc09c7b-5622-4696-a983-cb046ac57313 tempest-ProjectMemberTests-1072060943 None] Creating offline snapshot c3a4077a-12f3-444b-a8f7-dd2c29061165 of volume 0df6c17a-2c28-4d35-9cbb-05d327c06965 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cab3c2-8cd9-414a-b62d-bb4b582d9690]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4dc09c7b-5622-4696-a983-cb046ac57313 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:02 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c97689bf-1b81-41ea-b54e-89a6e50d6bbf tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.260s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-c97689bf-1b81-41ea-b54e-89a6e50d6bbf tempest-ProjectReaderTests-507375670 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:25:02 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c97689bf-1b81-41ea-b54e-89a6e50d6bbf tempest-ProjectReaderTests-507375670 None] Deleted volume successfully. Sep 01 12:25:02 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965 Sep 01 12:25:02 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c97689bf-1b81-41ea-b54e-89a6e50d6bbf tempest-ProjectReaderTests-507375670 None] Lock "cinder-66e40fbb-08ce-4acc-a687-db4e839c2197-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:02 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4dc09c7b-5622-4696-a983-cb046ac57313 tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965" returned: 0 in 0.396s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4dc09c7b-5622-4696-a983-cb046ac57313 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.c3a4077a-12f3-444b-a8f7-dd2c29061165 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:02 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.c3a4077a-12f3-444b-a8f7-dd2c29061165 1G Sep 01 12:25:02 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Flow 'volume_create_manager' (8a7dc57f-018e-479c-a2b7-63e561715f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68c20f6e-4cc8-4ec7-9e70-d65952e040ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68c20f6e-4cc8-4ec7-9e70-d65952e040ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-821414531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33103ad5-0646-4764-aef1-4a5fae7ee228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554d1f313f4d41198140f854d4acc488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:25:03Z,use_quota=True,user_id='70a0758d24234e578aa505d1ca02821b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db54be11-58dc-4bf8-a07c-d1c0a3941149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db54be11-58dc-4bf8-a07c-d1c0a3941149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2bc502-9855-4a7b-b903-4cc2176cf97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2bc502-9855-4a7b-b903-4cc2176cf97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33103ad5-0646-4764-aef1-4a5fae7ee228', 'volume_name': 'volume-33103ad5-0646-4764-aef1-4a5fae7ee228', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a31da3-7b5c-41b8-8201-80cf46db6e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a31da3-7b5c-41b8-8201-80cf46db6e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14dd01d0-6849-4797-9198-66538aaafdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:02 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Volume 33103ad5-0646-4764-aef1-4a5fae7ee228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33103ad5-0646-4764-aef1-4a5fae7ee228', 'volume_size': 1} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:02 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4dc09c7b-5622-4696-a983-cb046ac57313 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.c3a4077a-12f3-444b-a8f7-dd2c29061165 1G" returned: 0 in 0.406s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:02 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4dc09c7b-5622-4696-a983-cb046ac57313 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df6c17a-2c28-4d35-9cbb-05d327c06965 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.c3a4077a-12f3-444b-a8f7-dd2c29061165 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:03 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df6c17a-2c28-4d35-9cbb-05d327c06965 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.c3a4077a-12f3-444b-a8f7-dd2c29061165 Sep 01 12:25:03 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:03 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4dc09c7b-5622-4696-a983-cb046ac57313 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df6c17a-2c28-4d35-9cbb-05d327c06965 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.c3a4077a-12f3-444b-a8f7-dd2c29061165" returned: 0 in 0.286s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:03 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-4dc09c7b-5622-4696-a983-cb046ac57313 tempest-ProjectMemberTests-1072060943 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.c3a4077a-12f3-444b-a8f7-dd2c29061165 is being set with open permissions: ugo+rw Sep 01 12:25:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4dc09c7b-5622-4696-a983-cb046ac57313 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.c3a4077a-12f3-444b-a8f7-dd2c29061165 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:03 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.c3a4077a-12f3-444b-a8f7-dd2c29061165 Sep 01 12:25:03 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:03 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4dc09c7b-5622-4696-a983-cb046ac57313 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.c3a4077a-12f3-444b-a8f7-dd2c29061165" returned: 0 in 0.250s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4dc09c7b-5622-4696-a983-cb046ac57313 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:03 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.info Sep 01 12:25:03 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:03 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4dc09c7b-5622-4696-a983-cb046ac57313 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.info" returned: 0 in 0.261s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:03 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-4dc09c7b-5622-4696-a983-cb046ac57313 tempest-ProjectMemberTests-1072060943 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.info is being set with open permissions: ugo+rw Sep 01 12:25:03 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4dc09c7b-5622-4696-a983-cb046ac57313 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:03 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.info Sep 01 12:25:03 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:04 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4dc09c7b-5622-4696-a983-cb046ac57313 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.info" returned: 0 in 0.243s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4dc09c7b-5622-4696-a983-cb046ac57313 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.925s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.229s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-821414531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33103ad5-0646-4764-aef1-4a5fae7ee228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554d1f313f4d41198140f854d4acc488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:25:03Z,use_quota=True,user_id='70a0758d24234e578aa505d1ca02821b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Creating volume 33103ad5-0646-4764-aef1-4a5fae7ee228 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:25:04 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:04 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228 1073741824 Sep 01 12:25:04 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:04 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4dc09c7b-5622-4696-a983-cb046ac57313 tempest-ProjectMemberTests-1072060943 None] Create snapshot completed successfully Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-c3a4077a-12f3-444b-a8f7-dd2c29061165-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-c3a4077a-12f3-444b-a8f7-dd2c29061165-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-0df6c17a-2c28-4d35-9cbb-05d327c06965" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-0df6c17a-2c28-4d35-9cbb-05d327c06965" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-c3a4077a-12f3-444b-a8f7-dd2c29061165" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-c3a4077a-12f3-444b-a8f7-dd2c29061165" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] Deleting offline snapshot c3a4077a-12f3-444b-a8f7-dd2c29061165 of volume 0df6c17a-2c28-4d35-9cbb-05d327c06965 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] snapshot_file for this snap is: volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.c3a4077a-12f3-444b-a8f7-dd2c29061165 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25d4280-0a7b-489d-a634-47c1a5f383db]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.c3a4077a-12f3-444b-a8f7-dd2c29061165 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:04 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.c3a4077a-12f3-444b-a8f7-dd2c29061165 Sep 01 12:25:04 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:04 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228 1073741824" returned: 0 in 0.438s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:04 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228 Sep 01 12:25:04 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:04 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.c3a4077a-12f3-444b-a8f7-dd2c29061165" returned: 0 in 0.378s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0df6c17a-2c28-4d35-9cbb-05d327c06965(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f05897-8db1-41ee-9abc-ae5ffffd0216]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:04 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228" returned: 0 in 0.274s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14dd01d0-6849-4797-9198-66538aaafdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33103ad5-0646-4764-aef1-4a5fae7ee228', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd275c1-9446-4a70-a2dd-9c3ac878af03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:04 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Volume volume-33103ad5-0646-4764-aef1-4a5fae7ee228 (33103ad5-0646-4764-aef1-4a5fae7ee228): created successfully Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd275c1-9446-4a70-a2dd-9c3ac878af03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:04 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Flow 'volume_create_manager' (8a7dc57f-018e-479c-a2b7-63e561715f8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:25:04 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-14c2e5ef-67f2-45b6-9245-42363aa72d4e tempest-ProjectReaderTests-507375670 None] Created volume successfully. Sep 01 12:25:04 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965 Sep 01 12:25:04 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:05 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965" returned: 0 in 0.366s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.c3a4077a-12f3-444b-a8f7-dd2c29061165 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:05 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.c3a4077a-12f3-444b-a8f7-dd2c29061165 Sep 01 12:25:05 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:05 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.c3a4077a-12f3-444b-a8f7-dd2c29061165" returned: 0 in 0.311s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.c3a4077a-12f3-444b-a8f7-dd2c29061165 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:05 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.c3a4077a-12f3-444b-a8f7-dd2c29061165 Sep 01 12:25:05 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:05 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965.c3a4077a-12f3-444b-a8f7-dd2c29061165" returned: 0 in 0.232s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-c3a4077a-12f3-444b-a8f7-dd2c29061165" released by "_delete_snapshot" :: held 1.377s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-0df6c17a-2c28-4d35-9cbb-05d327c06965" released by "delete_snapshot" :: held 1.400s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:05 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] Created reservations ['73c4835b-ed71-48e6-9e9f-4fb3167ead4a', 'e635f3e7-ffc3-4e82-857d-b6b6f9ad126f', '1db77fde-3c4c-41d3-8aad-9eb6544bf2bb', '35ed862b-55cc-4c5b-9e6f-77374bb71430'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:25:05 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] Delete snapshot completed successfully. Sep 01 12:25:05 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7da4193c-d9d9-4ce5-aec7-81fec9e51b48 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-c3a4077a-12f3-444b-a8f7-dd2c29061165-delete_snapshot" released by "delete_snapshot" :: held 1.544s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0d4c984a-81d2-4cb3-831a-e344488dc171 tempest-ProjectReaderTests-507375670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:05 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0d4c984a-81d2-4cb3-831a-e344488dc171 tempest-ProjectReaderTests-507375670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:05 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-0d4c984a-81d2-4cb3-831a-e344488dc171 tempest-ProjectReaderTests-507375670 None] Creating offline snapshot 8956dd47-2e46-45cf-97bf-6315d1e1be83 of volume 33103ad5-0646-4764-aef1-4a5fae7ee228 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:25:06 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc601ee-1e08-4fa3-b265-88c5d198a1c9]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0d4c984a-81d2-4cb3-831a-e344488dc171 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:06 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228 Sep 01 12:25:06 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:06 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0d4c984a-81d2-4cb3-831a-e344488dc171 tempest-ProjectReaderTests-507375670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228" returned: 0 in 0.356s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0d4c984a-81d2-4cb3-831a-e344488dc171 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.8956dd47-2e46-45cf-97bf-6315d1e1be83 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:06 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.8956dd47-2e46-45cf-97bf-6315d1e1be83 1G Sep 01 12:25:06 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2bd29953-0ff1-4c52-91c0-1d866cc9f4ff tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-0df6c17a-2c28-4d35-9cbb-05d327c06965-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2bd29953-0ff1-4c52-91c0-1d866cc9f4ff tempest-ProjectMemberTests-1072060943 None] Lock "cinder-0df6c17a-2c28-4d35-9cbb-05d327c06965-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2bd29953-0ff1-4c52-91c0-1d866cc9f4ff tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-0df6c17a-2c28-4d35-9cbb-05d327c06965" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:06 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2bd29953-0ff1-4c52-91c0-1d866cc9f4ff tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-0df6c17a-2c28-4d35-9cbb-05d327c06965" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:06 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8ce6ea-207b-4a59-b840-eaabc0f47915]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2bd29953-0ff1-4c52-91c0-1d866cc9f4ff tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:06 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965 Sep 01 12:25:06 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:06 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0d4c984a-81d2-4cb3-831a-e344488dc171 tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.8956dd47-2e46-45cf-97bf-6315d1e1be83 1G" returned: 0 in 0.385s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0d4c984a-81d2-4cb3-831a-e344488dc171 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33103ad5-0646-4764-aef1-4a5fae7ee228 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.8956dd47-2e46-45cf-97bf-6315d1e1be83 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:06 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33103ad5-0646-4764-aef1-4a5fae7ee228 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.8956dd47-2e46-45cf-97bf-6315d1e1be83 Sep 01 12:25:06 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:06 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2bd29953-0ff1-4c52-91c0-1d866cc9f4ff tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965" returned: 0 in 0.357s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:06 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2bd29953-0ff1-4c52-91c0-1d866cc9f4ff tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:06 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965 Sep 01 12:25:06 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:07 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0d4c984a-81d2-4cb3-831a-e344488dc171 tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33103ad5-0646-4764-aef1-4a5fae7ee228 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.8956dd47-2e46-45cf-97bf-6315d1e1be83" returned: 0 in 0.295s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:07 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-0d4c984a-81d2-4cb3-831a-e344488dc171 tempest-ProjectReaderTests-507375670 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.8956dd47-2e46-45cf-97bf-6315d1e1be83 is being set with open permissions: ugo+rw Sep 01 12:25:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0d4c984a-81d2-4cb3-831a-e344488dc171 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.8956dd47-2e46-45cf-97bf-6315d1e1be83 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:07 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.8956dd47-2e46-45cf-97bf-6315d1e1be83 Sep 01 12:25:07 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:07 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2bd29953-0ff1-4c52-91c0-1d866cc9f4ff tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-0df6c17a-2c28-4d35-9cbb-05d327c06965" returned: 0 in 0.264s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2bd29953-0ff1-4c52-91c0-1d866cc9f4ff tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-0df6c17a-2c28-4d35-9cbb-05d327c06965" released by "delete_volume" :: held 0.674s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:07 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-2bd29953-0ff1-4c52-91c0-1d866cc9f4ff tempest-ProjectMemberTests-1072060943 None] Created reservations ['fea03664-c8a2-4a74-9aaa-391c835e6423', '730d5615-3f8d-4059-a2fe-133cb3cf7420', '0b6b5818-fa1f-485b-827f-90e9c93ac48b', '6a7ae73f-a2ba-4162-99ff-295cef50e106'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:25:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2bd29953-0ff1-4c52-91c0-1d866cc9f4ff tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2bd29953-0ff1-4c52-91c0-1d866cc9f4ff tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2bd29953-0ff1-4c52-91c0-1d866cc9f4ff tempest-ProjectMemberTests-1072060943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:07 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-2bd29953-0ff1-4c52-91c0-1d866cc9f4ff tempest-ProjectMemberTests-1072060943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-2bd29953-0ff1-4c52-91c0-1d866cc9f4ff tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2bd29953-0ff1-4c52-91c0-1d866cc9f4ff tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:07 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0d4c984a-81d2-4cb3-831a-e344488dc171 tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.8956dd47-2e46-45cf-97bf-6315d1e1be83" returned: 0 in 0.246s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:07 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:25:07 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0d4c984a-81d2-4cb3-831a-e344488dc171 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:07 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.info Sep 01 12:25:07 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:07 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2bd29953-0ff1-4c52-91c0-1d866cc9f4ff tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.245s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:07 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-2bd29953-0ff1-4c52-91c0-1d866cc9f4ff tempest-ProjectMemberTests-1072060943 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:25:07 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2bd29953-0ff1-4c52-91c0-1d866cc9f4ff tempest-ProjectMemberTests-1072060943 None] Deleted volume successfully. Sep 01 12:25:07 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2bd29953-0ff1-4c52-91c0-1d866cc9f4ff tempest-ProjectMemberTests-1072060943 None] Lock "cinder-0df6c17a-2c28-4d35-9cbb-05d327c06965-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:07 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0d4c984a-81d2-4cb3-831a-e344488dc171 tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.info" returned: 0 in 0.258s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:07 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-0d4c984a-81d2-4cb3-831a-e344488dc171 tempest-ProjectReaderTests-507375670 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.info is being set with open permissions: ugo+rw Sep 01 12:25:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0d4c984a-81d2-4cb3-831a-e344488dc171 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:07 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.info Sep 01 12:25:07 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:07 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0d4c984a-81d2-4cb3-831a-e344488dc171 tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.info" returned: 0 in 0.262s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:07 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0d4c984a-81d2-4cb3-831a-e344488dc171 tempest-ProjectReaderTests-507375670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.894s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:07 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0d4c984a-81d2-4cb3-831a-e344488dc171 tempest-ProjectReaderTests-507375670 None] Create snapshot completed successfully Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Flow 'volume_create_manager' (5ad036a1-83ba-440a-bece-1b071110f1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d05b4e-5c70-4319-bd4e-988ad4b2bd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-8956dd47-2e46-45cf-97bf-6315d1e1be83-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d05b4e-5c70-4319-bd4e-988ad4b2bd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2104574408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8243cc11-4bc8-40fc-b1bd-2975181c1fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f303c21f6004c3b8f3683085fa69682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:25:08Z,use_quota=True,user_id='6630d9cae50f4034a07faed651147f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bbc0b32-bd3c-4536-8b87-2097fe3015b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bbc0b32-bd3c-4536-8b87-2097fe3015b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a524abf-4714-479d-84d8-c264a59a0f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a524abf-4714-479d-84d8-c264a59a0f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8243cc11-4bc8-40fc-b1bd-2975181c1fb7', 'volume_name': 'volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b2f925-f911-4e89-8d95-3666560b67f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b2f925-f911-4e89-8d95-3666560b67f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fa9fdf-9ddf-4bc7-90e4-fb997258b138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:08 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Volume 8243cc11-4bc8-40fc-b1bd-2975181c1fb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7', 'volume_size': 1} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2104574408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8243cc11-4bc8-40fc-b1bd-2975181c1fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f303c21f6004c3b8f3683085fa69682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:25:08Z,use_quota=True,user_id='6630d9cae50f4034a07faed651147f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Creating volume 8243cc11-4bc8-40fc-b1bd-2975181c1fb7 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:25:08 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] Lock "cinder-8956dd47-2e46-45cf-97bf-6315d1e1be83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.091s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-quobyte-33103ad5-0646-4764-aef1-4a5fae7ee228" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:08 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7 1073741824 Sep 01 12:25:08 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-33103ad5-0646-4764-aef1-4a5fae7ee228" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-quobyte-8956dd47-2e46-45cf-97bf-6315d1e1be83" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-8956dd47-2e46-45cf-97bf-6315d1e1be83" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] Deleting offline snapshot 8956dd47-2e46-45cf-97bf-6315d1e1be83 of volume 33103ad5-0646-4764-aef1-4a5fae7ee228 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] snapshot_file for this snap is: volume-33103ad5-0646-4764-aef1-4a5fae7ee228.8956dd47-2e46-45cf-97bf-6315d1e1be83 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8991f69-5c3f-40da-a40a-d143f655b39e]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.8956dd47-2e46-45cf-97bf-6315d1e1be83 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:08 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.8956dd47-2e46-45cf-97bf-6315d1e1be83 Sep 01 12:25:08 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:08 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7 1073741824" returned: 0 in 0.406s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:08 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.8956dd47-2e46-45cf-97bf-6315d1e1be83" returned: 0 in 0.359s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33103ad5-0646-4764-aef1-4a5fae7ee228(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:25:08 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7 Sep 01 12:25:08 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[81365a99-08f4-4078-8033-a68df725a72d]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:08 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228 Sep 01 12:25:08 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:08 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7" returned: 0 in 0.239s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fa9fdf-9ddf-4bc7-90e4-fb997258b138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42732dc-1be3-4940-969c-43f94cc13812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:08 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Volume volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7 (8243cc11-4bc8-40fc-b1bd-2975181c1fb7): created successfully Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42732dc-1be3-4940-969c-43f94cc13812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:08 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Flow 'volume_create_manager' (5ad036a1-83ba-440a-bece-1b071110f1d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:25:08 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-582edd03-0e51-4601-a08f-b0db64293a01 tempest-ProjectMemberTests-1072060943 None] Created volume successfully. Sep 01 12:25:09 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228" returned: 0 in 0.375s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.8956dd47-2e46-45cf-97bf-6315d1e1be83 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:09 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.8956dd47-2e46-45cf-97bf-6315d1e1be83 Sep 01 12:25:09 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c05f3278-bd6c-429d-9449-05dce3033d01 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c05f3278-bd6c-429d-9449-05dce3033d01 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:09 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c05f3278-bd6c-429d-9449-05dce3033d01 tempest-ProjectMemberTests-1072060943 None] Creating offline snapshot 7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d of volume 8243cc11-4bc8-40fc-b1bd-2975181c1fb7 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:25:09 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9db16f-138d-46aa-9a8a-9cc9a03fbd26]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c05f3278-bd6c-429d-9449-05dce3033d01 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:09 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.8956dd47-2e46-45cf-97bf-6315d1e1be83" returned: 0 in 0.341s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.8956dd47-2e46-45cf-97bf-6315d1e1be83 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:09 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7 Sep 01 12:25:09 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:09 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.8956dd47-2e46-45cf-97bf-6315d1e1be83 Sep 01 12:25:09 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:09 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228.8956dd47-2e46-45cf-97bf-6315d1e1be83" returned: 0 in 0.235s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:09 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c05f3278-bd6c-429d-9449-05dce3033d01 tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7" returned: 0 in 0.352s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:09 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c05f3278-bd6c-429d-9449-05dce3033d01 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-8956dd47-2e46-45cf-97bf-6315d1e1be83" released by "_delete_snapshot" :: held 1.419s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-33103ad5-0646-4764-aef1-4a5fae7ee228" released by "delete_snapshot" :: held 1.444s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:09 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d 1G Sep 01 12:25:09 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:09 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] Created reservations ['6a4ea7f8-8e32-4d87-ab99-0e218eb40a5b', '44b949ef-0585-4449-8097-e9a0095921b1', 'af986c9e-6b43-4fe4-8239-fdc80d3d1616', '6a23420b-b77b-4188-a26b-5c04ffcc4229'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:25:09 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] Delete snapshot completed successfully. Sep 01 12:25:09 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-aaef47f3-f86f-4f7e-a062-78d8bf3b8418 tempest-ProjectReaderTests-507375670 None] Lock "cinder-8956dd47-2e46-45cf-97bf-6315d1e1be83-delete_snapshot" released by "delete_snapshot" :: held 1.581s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:10 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c05f3278-bd6c-429d-9449-05dce3033d01 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d 1G" returned: 0 in 0.383s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c05f3278-bd6c-429d-9449-05dce3033d01 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:10 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d Sep 01 12:25:10 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a8714cb9-98fb-420a-898a-0364e878069e tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-33103ad5-0646-4764-aef1-4a5fae7ee228-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a8714cb9-98fb-420a-898a-0364e878069e tempest-ProjectReaderTests-507375670 None] Lock "cinder-33103ad5-0646-4764-aef1-4a5fae7ee228-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a8714cb9-98fb-420a-898a-0364e878069e tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-quobyte-33103ad5-0646-4764-aef1-4a5fae7ee228" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:10 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:10 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a8714cb9-98fb-420a-898a-0364e878069e tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-33103ad5-0646-4764-aef1-4a5fae7ee228" acquired by "delete_volume" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c05f3278-bd6c-429d-9449-05dce3033d01 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d" returned: 0 in 0.340s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:10 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-c05f3278-bd6c-429d-9449-05dce3033d01 tempest-ProjectMemberTests-1072060943 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d is being set with open permissions: ugo+rw Sep 01 12:25:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c05f3278-bd6c-429d-9449-05dce3033d01 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:10 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[055cca36-9260-4742-928a-bdd190f20c96]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8714cb9-98fb-420a-898a-0364e878069e tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:10 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d Sep 01 12:25:10 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:10 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228 Sep 01 12:25:10 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:10 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c05f3278-bd6c-429d-9449-05dce3033d01 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d" returned: 0 in 0.261s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c05f3278-bd6c-429d-9449-05dce3033d01 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:10 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.info Sep 01 12:25:10 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:10 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8714cb9-98fb-420a-898a-0364e878069e tempest-ProjectReaderTests-507375670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228" returned: 0 in 0.372s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8714cb9-98fb-420a-898a-0364e878069e tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:10 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228 Sep 01 12:25:10 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:10 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c05f3278-bd6c-429d-9449-05dce3033d01 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.info" returned: 0 in 0.278s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:10 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-c05f3278-bd6c-429d-9449-05dce3033d01 tempest-ProjectMemberTests-1072060943 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.info is being set with open permissions: ugo+rw Sep 01 12:25:10 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c05f3278-bd6c-429d-9449-05dce3033d01 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:10 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.info Sep 01 12:25:10 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:11 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8714cb9-98fb-420a-898a-0364e878069e tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-33103ad5-0646-4764-aef1-4a5fae7ee228" returned: 0 in 0.261s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a8714cb9-98fb-420a-898a-0364e878069e tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-33103ad5-0646-4764-aef1-4a5fae7ee228" released by "delete_volume" :: held 0.694s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a8714cb9-98fb-420a-898a-0364e878069e tempest-ProjectReaderTests-507375670 None] Created reservations ['45ce1d70-5d81-4b7b-b218-8d26ae79373a', '5cf525c1-907e-4ed7-b633-9ef3ba375d6e', 'ee91289e-c5d2-4576-8c59-cfebafadea5b', '047f4180-8d17-4060-902f-b4d458e5a443'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a8714cb9-98fb-420a-898a-0364e878069e tempest-ProjectReaderTests-507375670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a8714cb9-98fb-420a-898a-0364e878069e tempest-ProjectReaderTests-507375670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a8714cb9-98fb-420a-898a-0364e878069e tempest-ProjectReaderTests-507375670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-a8714cb9-98fb-420a-898a-0364e878069e tempest-ProjectReaderTests-507375670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-a8714cb9-98fb-420a-898a-0364e878069e tempest-ProjectReaderTests-507375670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8714cb9-98fb-420a-898a-0364e878069e tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:11 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:25:11 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:11 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c05f3278-bd6c-429d-9449-05dce3033d01 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.info" returned: 0 in 0.274s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c05f3278-bd6c-429d-9449-05dce3033d01 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.985s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:11 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c05f3278-bd6c-429d-9449-05dce3033d01 tempest-ProjectMemberTests-1072060943 None] Create snapshot completed successfully Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-8243cc11-4bc8-40fc-b1bd-2975181c1fb7" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:11 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-8243cc11-4bc8-40fc-b1bd-2975181c1fb7" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a8714cb9-98fb-420a-898a-0364e878069e tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.277s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-a8714cb9-98fb-420a-898a-0364e878069e tempest-ProjectReaderTests-507375670 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:25:11 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a8714cb9-98fb-420a-898a-0364e878069e tempest-ProjectReaderTests-507375670 None] Deleted volume successfully. Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] Deleting offline snapshot 7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d of volume 8243cc11-4bc8-40fc-b1bd-2975181c1fb7 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] snapshot_file for this snap is: volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a8714cb9-98fb-420a-898a-0364e878069e tempest-ProjectReaderTests-507375670 None] Lock "cinder-33103ad5-0646-4764-aef1-4a5fae7ee228-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[42432825-8879-40b1-9560-980154fa3b52]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:11 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d Sep 01 12:25:11 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:25:11 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Flow 'volume_create_manager' (8799d0ce-d637-4cd9-be14-2517be015777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a39a16e-b519-44c0-ac61-7f24985d6a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d" returned: 0 in 0.435s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a39a16e-b519-44c0-ac61-7f24985d6a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2015217321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5490767-a7ec-4715-a543-f0c281bb1501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554d1f313f4d41198140f854d4acc488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:25:12Z,use_quota=True,user_id='70a0758d24234e578aa505d1ca02821b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf462a8-1db7-4359-a8c9-6c467457b758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf462a8-1db7-4359-a8c9-6c467457b758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:11 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4120d311-3db0-4682-8eaf-7bbff8ea3d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4120d311-3db0-4682-8eaf-7bbff8ea3d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5490767-a7ec-4715-a543-f0c281bb1501', 'volume_name': 'volume-d5490767-a7ec-4715-a543-f0c281bb1501', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6370dd99-73b9-4751-8d11-5f2269147ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6370dd99-73b9-4751-8d11-5f2269147ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda3da3b-dc13-4ea4-bee1-0f36bc992aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:12 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Volume d5490767-a7ec-4715-a543-f0c281bb1501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5490767-a7ec-4715-a543-f0c281bb1501', 'volume_size': 1} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2015217321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5490767-a7ec-4715-a543-f0c281bb1501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554d1f313f4d41198140f854d4acc488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:25:12Z,use_quota=True,user_id='70a0758d24234e578aa505d1ca02821b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Creating volume d5490767-a7ec-4715-a543-f0c281bb1501 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:25:12 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21b572c-5aa5-4be9-b0df-5292a7bf5231]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:12 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501 1073741824 Sep 01 12:25:12 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:12 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7 Sep 01 12:25:12 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:12 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7" returned: 0 in 0.363s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:12 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d Sep 01 12:25:12 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:12 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501 1073741824" returned: 0 in 0.410s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:12 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501 Sep 01 12:25:12 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:12 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501" returned: 0 in 0.246s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda3da3b-dc13-4ea4-bee1-0f36bc992aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5490767-a7ec-4715-a543-f0c281bb1501', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb462d6e-14cc-4cbb-aa79-ca8daa50608d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:12 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:12 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Volume volume-d5490767-a7ec-4715-a543-f0c281bb1501 (d5490767-a7ec-4715-a543-f0c281bb1501): created successfully Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb462d6e-14cc-4cbb-aa79-ca8daa50608d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Flow 'volume_create_manager' (8799d0ce-d637-4cd9-be14-2517be015777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d" returned: 0 in 0.362s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:12 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:12 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-04e7294c-4522-4a47-a16b-737a5c53eeef tempest-ProjectReaderTests-507375670 None] Created volume successfully. Sep 01 12:25:12 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d Sep 01 12:25:12 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:13 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7.7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d" returned: 0 in 0.257s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d" released by "_delete_snapshot" :: held 1.591s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-8243cc11-4bc8-40fc-b1bd-2975181c1fb7" released by "delete_snapshot" :: held 1.618s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-49ca5afd-0d7b-431c-af93-f48fda82722f tempest-ProjectReaderTests-507375670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-49ca5afd-0d7b-431c-af93-f48fda82722f tempest-ProjectReaderTests-507375670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:13 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-49ca5afd-0d7b-431c-af93-f48fda82722f tempest-ProjectReaderTests-507375670 None] Creating offline snapshot 57fd9114-9a35-466f-ac02-0c1a7fe49b5c of volume d5490767-a7ec-4715-a543-f0c281bb1501 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:25:13 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d375f604-9b12-41d2-961f-2ab8d0c8959c]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-49ca5afd-0d7b-431c-af93-f48fda82722f tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:13 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] Created reservations ['f4da86b0-442e-4989-91dc-fd3317cfaa1e', 'e60f39cf-6f1f-4add-9e8a-47adc4d2b331', '64afc7c1-52bf-4f2a-a553-ebc61a7265d0', '27fd5393-c83b-4e3f-84f2-04aef13bf012'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:25:13 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] Delete snapshot completed successfully. Sep 01 12:25:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-41f2c7e1-bf20-4b4d-9a5c-b4c06e642593 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-7e2ebd2d-45dd-4d81-bd05-1ae89dd7ac9d-delete_snapshot" released by "delete_snapshot" :: held 1.801s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:13 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501 Sep 01 12:25:13 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:13 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-49ca5afd-0d7b-431c-af93-f48fda82722f tempest-ProjectReaderTests-507375670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501" returned: 0 in 0.368s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-49ca5afd-0d7b-431c-af93-f48fda82722f tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.57fd9114-9a35-466f-ac02-0c1a7fe49b5c 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:13 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.57fd9114-9a35-466f-ac02-0c1a7fe49b5c 1G Sep 01 12:25:13 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-46dc2999-8a96-4d1f-a3de-b4998725d590 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-8243cc11-4bc8-40fc-b1bd-2975181c1fb7-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-46dc2999-8a96-4d1f-a3de-b4998725d590 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-8243cc11-4bc8-40fc-b1bd-2975181c1fb7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-46dc2999-8a96-4d1f-a3de-b4998725d590 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-8243cc11-4bc8-40fc-b1bd-2975181c1fb7" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:13 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-46dc2999-8a96-4d1f-a3de-b4998725d590 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-8243cc11-4bc8-40fc-b1bd-2975181c1fb7" acquired by "delete_volume" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:13 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0eb03f-52d2-4702-a90b-64ca7379d5ef]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-46dc2999-8a96-4d1f-a3de-b4998725d590 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:13 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7 Sep 01 12:25:13 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:13 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-49ca5afd-0d7b-431c-af93-f48fda82722f tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.57fd9114-9a35-466f-ac02-0c1a7fe49b5c 1G" returned: 0 in 0.410s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:13 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-49ca5afd-0d7b-431c-af93-f48fda82722f tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5490767-a7ec-4715-a543-f0c281bb1501 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.57fd9114-9a35-466f-ac02-0c1a7fe49b5c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:13 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5490767-a7ec-4715-a543-f0c281bb1501 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.57fd9114-9a35-466f-ac02-0c1a7fe49b5c Sep 01 12:25:13 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:14 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-46dc2999-8a96-4d1f-a3de-b4998725d590 tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7" returned: 0 in 0.380s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-46dc2999-8a96-4d1f-a3de-b4998725d590 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:14 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7 Sep 01 12:25:14 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:14 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-49ca5afd-0d7b-431c-af93-f48fda82722f tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5490767-a7ec-4715-a543-f0c281bb1501 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.57fd9114-9a35-466f-ac02-0c1a7fe49b5c" returned: 0 in 0.313s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:14 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-49ca5afd-0d7b-431c-af93-f48fda82722f tempest-ProjectReaderTests-507375670 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.57fd9114-9a35-466f-ac02-0c1a7fe49b5c is being set with open permissions: ugo+rw Sep 01 12:25:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-49ca5afd-0d7b-431c-af93-f48fda82722f tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.57fd9114-9a35-466f-ac02-0c1a7fe49b5c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:14 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.57fd9114-9a35-466f-ac02-0c1a7fe49b5c Sep 01 12:25:14 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:14 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-46dc2999-8a96-4d1f-a3de-b4998725d590 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-8243cc11-4bc8-40fc-b1bd-2975181c1fb7" returned: 0 in 0.252s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-46dc2999-8a96-4d1f-a3de-b4998725d590 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-8243cc11-4bc8-40fc-b1bd-2975181c1fb7" released by "delete_volume" :: held 0.694s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:14 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-46dc2999-8a96-4d1f-a3de-b4998725d590 tempest-ProjectMemberTests-1072060943 None] Created reservations ['24f7809d-80b4-4b63-aaff-9baa95dd7de9', '2b109b0c-d9b0-472d-a2eb-41fd78c6db2f', 'e6e65926-cdeb-490b-b06d-1651d60f9f08', 'e786a29c-b662-4d32-b5ed-09f5799eea40'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:25:14 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-49ca5afd-0d7b-431c-af93-f48fda82722f tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.57fd9114-9a35-466f-ac02-0c1a7fe49b5c" returned: 0 in 0.247s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-46dc2999-8a96-4d1f-a3de-b4998725d590 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-46dc2999-8a96-4d1f-a3de-b4998725d590 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-46dc2999-8a96-4d1f-a3de-b4998725d590 tempest-ProjectMemberTests-1072060943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:14 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-46dc2999-8a96-4d1f-a3de-b4998725d590 tempest-ProjectMemberTests-1072060943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-46dc2999-8a96-4d1f-a3de-b4998725d590 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-46dc2999-8a96-4d1f-a3de-b4998725d590 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-49ca5afd-0d7b-431c-af93-f48fda82722f tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:14 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:25:14 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:14 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.info Sep 01 12:25:14 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:14 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-46dc2999-8a96-4d1f-a3de-b4998725d590 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.260s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:14 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-46dc2999-8a96-4d1f-a3de-b4998725d590 tempest-ProjectMemberTests-1072060943 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:25:14 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-46dc2999-8a96-4d1f-a3de-b4998725d590 tempest-ProjectMemberTests-1072060943 None] Deleted volume successfully. Sep 01 12:25:14 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-49ca5afd-0d7b-431c-af93-f48fda82722f tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.info" returned: 0 in 0.280s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:14 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-49ca5afd-0d7b-431c-af93-f48fda82722f tempest-ProjectReaderTests-507375670 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.info is being set with open permissions: ugo+rw Sep 01 12:25:14 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-49ca5afd-0d7b-431c-af93-f48fda82722f tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:14 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-46dc2999-8a96-4d1f-a3de-b4998725d590 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-8243cc11-4bc8-40fc-b1bd-2975181c1fb7-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:14 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.info Sep 01 12:25:14 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:15 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-49ca5afd-0d7b-431c-af93-f48fda82722f tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.info" returned: 0 in 0.261s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-49ca5afd-0d7b-431c-af93-f48fda82722f tempest-ProjectReaderTests-507375670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.985s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:15 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-49ca5afd-0d7b-431c-af93-f48fda82722f tempest-ProjectReaderTests-507375670 None] Create snapshot completed successfully Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Flow 'volume_create_manager' (13b16922-31aa-4965-98e0-ca663d21039a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a36b67f3-82b3-4542-8781-1a1e46bab437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-57fd9114-9a35-466f-ac02-0c1a7fe49b5c-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a36b67f3-82b3-4542-8781-1a1e46bab437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1185036137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e070b43-1bd3-4091-b324-946821da820b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f303c21f6004c3b8f3683085fa69682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:25:15Z,use_quota=True,user_id='6630d9cae50f4034a07faed651147f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a02697-deeb-4557-8853-d4077bf9f3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a02697-deeb-4557-8853-d4077bf9f3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbff9190-79d8-4857-bf75-1d751f678ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbff9190-79d8-4857-bf75-1d751f678ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e070b43-1bd3-4091-b324-946821da820b', 'volume_name': 'volume-1e070b43-1bd3-4091-b324-946821da820b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9914a46-f2da-410d-b4ad-a71db6ab379c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9914a46-f2da-410d-b4ad-a71db6ab379c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94686787-4e9c-426f-a640-02a52a499519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:15 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Volume 1e070b43-1bd3-4091-b324-946821da820b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e070b43-1bd3-4091-b324-946821da820b', 'volume_size': 1} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1185036137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e070b43-1bd3-4091-b324-946821da820b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f303c21f6004c3b8f3683085fa69682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:25:15Z,use_quota=True,user_id='6630d9cae50f4034a07faed651147f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Creating volume 1e070b43-1bd3-4091-b324-946821da820b {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:25:15 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] Lock "cinder-57fd9114-9a35-466f-ac02-0c1a7fe49b5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-quobyte-d5490767-a7ec-4715-a543-f0c281bb1501" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:15 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b 1073741824 Sep 01 12:25:15 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-d5490767-a7ec-4715-a543-f0c281bb1501" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-quobyte-57fd9114-9a35-466f-ac02-0c1a7fe49b5c" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-57fd9114-9a35-466f-ac02-0c1a7fe49b5c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] Deleting offline snapshot 57fd9114-9a35-466f-ac02-0c1a7fe49b5c of volume d5490767-a7ec-4715-a543-f0c281bb1501 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] snapshot_file for this snap is: volume-d5490767-a7ec-4715-a543-f0c281bb1501.57fd9114-9a35-466f-ac02-0c1a7fe49b5c {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4724d0-5611-4f30-8332-7635bd7bf4a5]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.57fd9114-9a35-466f-ac02-0c1a7fe49b5c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:15 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.57fd9114-9a35-466f-ac02-0c1a7fe49b5c Sep 01 12:25:15 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:15 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b 1073741824" returned: 0 in 0.431s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:15 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.57fd9114-9a35-466f-ac02-0c1a7fe49b5c" returned: 0 in 0.399s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5490767-a7ec-4715-a543-f0c281bb1501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:25:15 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b Sep 01 12:25:15 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb9ba94-0b6b-4304-901c-3dfe33b3e5fa]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:15 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501 Sep 01 12:25:15 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:16 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b" returned: 0 in 0.284s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:25:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94686787-4e9c-426f-a640-02a52a499519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e070b43-1bd3-4091-b324-946821da820b', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb47821-e811-4644-a9d9-8208969ca5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:16 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Volume volume-1e070b43-1bd3-4091-b324-946821da820b (1e070b43-1bd3-4091-b324-946821da820b): created successfully Sep 01 12:25:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb47821-e811-4644-a9d9-8208969ca5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Flow 'volume_create_manager' (13b16922-31aa-4965-98e0-ca663d21039a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:25:16 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7d25fde7-baf9-46db-9d25-42d4fe01de09 tempest-ProjectMemberTests-1072060943 None] Created volume successfully. Sep 01 12:25:16 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501" returned: 0 in 0.440s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.57fd9114-9a35-466f-ac02-0c1a7fe49b5c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:16 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.57fd9114-9a35-466f-ac02-0c1a7fe49b5c Sep 01 12:25:16 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:16 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.57fd9114-9a35-466f-ac02-0c1a7fe49b5c" returned: 0 in 0.359s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.57fd9114-9a35-466f-ac02-0c1a7fe49b5c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:16 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.57fd9114-9a35-466f-ac02-0c1a7fe49b5c Sep 01 12:25:16 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:16 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501.57fd9114-9a35-466f-ac02-0c1a7fe49b5c" returned: 0 in 0.246s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-57fd9114-9a35-466f-ac02-0c1a7fe49b5c" released by "_delete_snapshot" :: held 1.541s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:16 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-d5490767-a7ec-4715-a543-f0c281bb1501" released by "delete_snapshot" :: held 1.563s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:16 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] Created reservations ['b5574945-535e-4b66-90df-ce1340ecc30d', '61f2109d-3e00-4fcc-af3a-d4beaa54d6c2', '6abd2cb7-3565-4825-905a-6f04fb035117', 'ea85f48a-c42f-4205-96f3-58060c1230d6'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:25:17 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] Delete snapshot completed successfully. Sep 01 12:25:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-2a8755e2-a08f-4492-845a-021aa25c527e tempest-ProjectReaderTests-507375670 None] Lock "cinder-57fd9114-9a35-466f-ac02-0c1a7fe49b5c-delete_snapshot" released by "delete_snapshot" :: held 1.691s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5c34ccf5-b241-42ae-85b7-aab57f801c7f tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-d5490767-a7ec-4715-a543-f0c281bb1501-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3c993f31-4a02-436a-b8ae-ec904cdccd7b tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3c993f31-4a02-436a-b8ae-ec904cdccd7b tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:17 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-3c993f31-4a02-436a-b8ae-ec904cdccd7b tempest-ProjectMemberTests-1072060943 None] Creating offline snapshot 07cce23c-d214-4c0a-b319-c48c70a1d694 of volume 1e070b43-1bd3-4091-b324-946821da820b {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:25:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5c34ccf5-b241-42ae-85b7-aab57f801c7f tempest-ProjectReaderTests-507375670 None] Lock "cinder-d5490767-a7ec-4715-a543-f0c281bb1501-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:17 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9088f9f-1b76-44bc-9948-98772a38a27a]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c993f31-4a02-436a-b8ae-ec904cdccd7b tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5c34ccf5-b241-42ae-85b7-aab57f801c7f tempest-ProjectReaderTests-507375670 None] Acquiring lock "cinder-quobyte-d5490767-a7ec-4715-a543-f0c281bb1501" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:17 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5c34ccf5-b241-42ae-85b7-aab57f801c7f tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-d5490767-a7ec-4715-a543-f0c281bb1501" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:17 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5235874-40d5-401f-a666-0d75808c5e69]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c34ccf5-b241-42ae-85b7-aab57f801c7f tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:17 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b Sep 01 12:25:17 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:17 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501 Sep 01 12:25:17 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:17 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c993f31-4a02-436a-b8ae-ec904cdccd7b tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b" returned: 0 in 0.372s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c993f31-4a02-436a-b8ae-ec904cdccd7b tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.07cce23c-d214-4c0a-b319-c48c70a1d694 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:17 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.07cce23c-d214-4c0a-b319-c48c70a1d694 1G Sep 01 12:25:17 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:17 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c34ccf5-b241-42ae-85b7-aab57f801c7f tempest-ProjectReaderTests-507375670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501" returned: 0 in 0.362s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c34ccf5-b241-42ae-85b7-aab57f801c7f tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:17 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501 Sep 01 12:25:17 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:18 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c34ccf5-b241-42ae-85b7-aab57f801c7f tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-d5490767-a7ec-4715-a543-f0c281bb1501" returned: 0 in 0.247s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5c34ccf5-b241-42ae-85b7-aab57f801c7f tempest-ProjectReaderTests-507375670 None] Lock "cinder-quobyte-d5490767-a7ec-4715-a543-f0c281bb1501" released by "delete_volume" :: held 0.663s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:18 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-5c34ccf5-b241-42ae-85b7-aab57f801c7f tempest-ProjectReaderTests-507375670 None] Created reservations ['2fe82496-f27d-47ca-9f01-f41e3d07b27b', 'bc7e064b-5527-477e-b0f3-3c413676f50f', 'a68fc808-9f95-4c17-b693-20b1b92d735f', 'c80ccb69-5c93-4587-a283-8a8de1fba25b'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:25:18 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c993f31-4a02-436a-b8ae-ec904cdccd7b tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.07cce23c-d214-4c0a-b319-c48c70a1d694 1G" returned: 0 in 0.409s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c993f31-4a02-436a-b8ae-ec904cdccd7b tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e070b43-1bd3-4091-b324-946821da820b -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.07cce23c-d214-4c0a-b319-c48c70a1d694 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:18 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e070b43-1bd3-4091-b324-946821da820b -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.07cce23c-d214-4c0a-b319-c48c70a1d694 Sep 01 12:25:18 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5c34ccf5-b241-42ae-85b7-aab57f801c7f tempest-ProjectReaderTests-507375670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5c34ccf5-b241-42ae-85b7-aab57f801c7f tempest-ProjectReaderTests-507375670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5c34ccf5-b241-42ae-85b7-aab57f801c7f tempest-ProjectReaderTests-507375670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:18 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5c34ccf5-b241-42ae-85b7-aab57f801c7f tempest-ProjectReaderTests-507375670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5c34ccf5-b241-42ae-85b7-aab57f801c7f tempest-ProjectReaderTests-507375670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c34ccf5-b241-42ae-85b7-aab57f801c7f tempest-ProjectReaderTests-507375670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:18 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:25:18 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:18 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c993f31-4a02-436a-b8ae-ec904cdccd7b tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e070b43-1bd3-4091-b324-946821da820b -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.07cce23c-d214-4c0a-b319-c48c70a1d694" returned: 0 in 0.315s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:18 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:18 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-3c993f31-4a02-436a-b8ae-ec904cdccd7b tempest-ProjectMemberTests-1072060943 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.07cce23c-d214-4c0a-b319-c48c70a1d694 is being set with open permissions: ugo+rw Sep 01 12:25:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c993f31-4a02-436a-b8ae-ec904cdccd7b tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.07cce23c-d214-4c0a-b319-c48c70a1d694 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5c34ccf5-b241-42ae-85b7-aab57f801c7f tempest-ProjectReaderTests-507375670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.274s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:18 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-5c34ccf5-b241-42ae-85b7-aab57f801c7f tempest-ProjectReaderTests-507375670 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:25:18 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5c34ccf5-b241-42ae-85b7-aab57f801c7f tempest-ProjectReaderTests-507375670 None] Deleted volume successfully. Sep 01 12:25:18 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.07cce23c-d214-4c0a-b319-c48c70a1d694 Sep 01 12:25:18 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:18 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-5c34ccf5-b241-42ae-85b7-aab57f801c7f tempest-ProjectReaderTests-507375670 None] Lock "cinder-d5490767-a7ec-4715-a543-f0c281bb1501-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:18 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c993f31-4a02-436a-b8ae-ec904cdccd7b tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.07cce23c-d214-4c0a-b319-c48c70a1d694" returned: 0 in 0.278s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c993f31-4a02-436a-b8ae-ec904cdccd7b tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:18 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.info Sep 01 12:25:18 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:19 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c993f31-4a02-436a-b8ae-ec904cdccd7b tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.info" returned: 0 in 0.256s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:19 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-3c993f31-4a02-436a-b8ae-ec904cdccd7b tempest-ProjectMemberTests-1072060943 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.info is being set with open permissions: ugo+rw Sep 01 12:25:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c993f31-4a02-436a-b8ae-ec904cdccd7b tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:19 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.info Sep 01 12:25:19 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:19 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-3c993f31-4a02-436a-b8ae-ec904cdccd7b tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.info" returned: 0 in 0.255s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-3c993f31-4a02-436a-b8ae-ec904cdccd7b tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:19 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-3c993f31-4a02-436a-b8ae-ec904cdccd7b tempest-ProjectMemberTests-1072060943 None] Create snapshot completed successfully Sep 01 12:25:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-07cce23c-d214-4c0a-b319-c48c70a1d694-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-07cce23c-d214-4c0a-b319-c48c70a1d694-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-1e070b43-1bd3-4091-b324-946821da820b" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-1e070b43-1bd3-4091-b324-946821da820b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-07cce23c-d214-4c0a-b319-c48c70a1d694" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:20 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-07cce23c-d214-4c0a-b319-c48c70a1d694" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] Deleting offline snapshot 07cce23c-d214-4c0a-b319-c48c70a1d694 of volume 1e070b43-1bd3-4091-b324-946821da820b {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:25:20 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] snapshot_file for this snap is: volume-1e070b43-1bd3-4091-b324-946821da820b.07cce23c-d214-4c0a-b319-c48c70a1d694 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:25:20 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c25e462-bdcf-4fad-b32e-ee126759c0ee]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:20 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.07cce23c-d214-4c0a-b319-c48c70a1d694 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:20 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.07cce23c-d214-4c0a-b319-c48c70a1d694 Sep 01 12:25:20 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:21 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.07cce23c-d214-4c0a-b319-c48c70a1d694" returned: 0 in 0.372s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:21 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e070b43-1bd3-4091-b324-946821da820b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:25:21 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a81138-5778-4a50-9bf8-b4d2254807c8]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:21 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b Sep 01 12:25:21 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:21 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b" returned: 0 in 0.378s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.07cce23c-d214-4c0a-b319-c48c70a1d694 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:21 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.07cce23c-d214-4c0a-b319-c48c70a1d694 Sep 01 12:25:21 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:21 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.07cce23c-d214-4c0a-b319-c48c70a1d694" returned: 0 in 0.367s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:21 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.07cce23c-d214-4c0a-b319-c48c70a1d694 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:21 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.07cce23c-d214-4c0a-b319-c48c70a1d694 Sep 01 12:25:21 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:22 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b.07cce23c-d214-4c0a-b319-c48c70a1d694" returned: 0 in 0.258s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-07cce23c-d214-4c0a-b319-c48c70a1d694" released by "_delete_snapshot" :: held 1.500s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-1e070b43-1bd3-4091-b324-946821da820b" released by "delete_snapshot" :: held 1.533s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:22 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] Created reservations ['ecba1265-d204-4244-8433-8bca0da7ea55', '65508461-74d3-4f3e-9ed2-881dcdd962cd', '65afb646-8092-4ea3-838c-7f656c642e78', 'd034f97f-b873-4035-b7f4-2cff0cdf734f'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:25:22 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] Delete snapshot completed successfully. Sep 01 12:25:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-afac69a4-09c2-4ed0-8c9c-43854f2beb77 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-07cce23c-d214-4c0a-b319-c48c70a1d694-delete_snapshot" released by "delete_snapshot" :: held 1.698s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-199b7fb8-5ad0-479c-a6be-a97445590f69 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-1e070b43-1bd3-4091-b324-946821da820b-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-199b7fb8-5ad0-479c-a6be-a97445590f69 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-1e070b43-1bd3-4091-b324-946821da820b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-199b7fb8-5ad0-479c-a6be-a97445590f69 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-1e070b43-1bd3-4091-b324-946821da820b" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:22 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-199b7fb8-5ad0-479c-a6be-a97445590f69 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-1e070b43-1bd3-4091-b324-946821da820b" acquired by "delete_volume" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:22 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[24666adb-5269-47aa-9ca0-08445957294a]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:22 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-199b7fb8-5ad0-479c-a6be-a97445590f69 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:22 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b Sep 01 12:25:22 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:23 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-199b7fb8-5ad0-479c-a6be-a97445590f69 tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b" returned: 0 in 0.352s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-199b7fb8-5ad0-479c-a6be-a97445590f69 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:23 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b Sep 01 12:25:23 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:23 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-199b7fb8-5ad0-479c-a6be-a97445590f69 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-1e070b43-1bd3-4091-b324-946821da820b" returned: 0 in 0.259s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-199b7fb8-5ad0-479c-a6be-a97445590f69 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-1e070b43-1bd3-4091-b324-946821da820b" released by "delete_volume" :: held 0.680s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:23 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-199b7fb8-5ad0-479c-a6be-a97445590f69 tempest-ProjectMemberTests-1072060943 None] Created reservations ['bac51ff6-006d-4d67-8990-d677d4c66b7e', 'fd042161-8d15-407a-88fc-8bdec6844870', 'bce2bf14-283b-4d68-a9d8-c944357e8b89', 'a9421bca-fad4-4580-97ef-a3460afa7812'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:25:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-199b7fb8-5ad0-479c-a6be-a97445590f69 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-199b7fb8-5ad0-479c-a6be-a97445590f69 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-199b7fb8-5ad0-479c-a6be-a97445590f69 tempest-ProjectMemberTests-1072060943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:23 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-199b7fb8-5ad0-479c-a6be-a97445590f69 tempest-ProjectMemberTests-1072060943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-199b7fb8-5ad0-479c-a6be-a97445590f69 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-199b7fb8-5ad0-479c-a6be-a97445590f69 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:23 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:25:23 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:23 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-199b7fb8-5ad0-479c-a6be-a97445590f69 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.260s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:23 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-199b7fb8-5ad0-479c-a6be-a97445590f69 tempest-ProjectMemberTests-1072060943 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:25:23 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-199b7fb8-5ad0-479c-a6be-a97445590f69 tempest-ProjectMemberTests-1072060943 None] Deleted volume successfully. Sep 01 12:25:23 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-199b7fb8-5ad0-479c-a6be-a97445590f69 tempest-ProjectMemberTests-1072060943 None] Lock "cinder-1e070b43-1bd3-4091-b324-946821da820b-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Flow 'volume_create_manager' (7104088a-20cb-42c5-bc50-ba4b7cba0982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d07cfe-3133-42b3-ab40-0731c04d1e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d07cfe-3133-42b3-ab40-0731c04d1e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1512752112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e64051-b047-45d1-b6eb-c214e82dc103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f303c21f6004c3b8f3683085fa69682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:25:25Z,use_quota=True,user_id='6630d9cae50f4034a07faed651147f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96f8688c-5209-4e36-96af-fc777a983fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96f8688c-5209-4e36-96af-fc777a983fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eee7855-681d-4890-b299-ab98334fb5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eee7855-681d-4890-b299-ab98334fb5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77e64051-b047-45d1-b6eb-c214e82dc103', 'volume_name': 'volume-77e64051-b047-45d1-b6eb-c214e82dc103', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc29cd0-2d24-49cc-ab83-775b78017047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc29cd0-2d24-49cc-ab83-775b78017047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f23b01-5315-4d6d-9350-720e38c84b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:24 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Volume 77e64051-b047-45d1-b6eb-c214e82dc103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77e64051-b047-45d1-b6eb-c214e82dc103', 'volume_size': 1} Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1512752112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e64051-b047-45d1-b6eb-c214e82dc103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f303c21f6004c3b8f3683085fa69682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:25:25Z,use_quota=True,user_id='6630d9cae50f4034a07faed651147f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Creating volume 77e64051-b047-45d1-b6eb-c214e82dc103 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:25:24 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:25:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:24 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103 1073741824 Sep 01 12:25:24 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:25 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103 1073741824" returned: 0 in 0.398s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:25 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103 Sep 01 12:25:25 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:25 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103" returned: 0 in 0.262s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:25:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f23b01-5315-4d6d-9350-720e38c84b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e64051-b047-45d1-b6eb-c214e82dc103', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5936a377-90b6-4148-9efd-ba442e65d619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:25 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Volume volume-77e64051-b047-45d1-b6eb-c214e82dc103 (77e64051-b047-45d1-b6eb-c214e82dc103): created successfully Sep 01 12:25:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5936a377-90b6-4148-9efd-ba442e65d619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:25 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Flow 'volume_create_manager' (7104088a-20cb-42c5-bc50-ba4b7cba0982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:25:25 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-4b165738-af98-41a3-9a77-6a46424bf7d7 tempest-ProjectMemberTests-1072060943 None] Created volume successfully. Sep 01 12:25:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-117f3453-45f5-4d94-a11a-53123f29d8ad tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-117f3453-45f5-4d94-a11a-53123f29d8ad tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:26 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-117f3453-45f5-4d94-a11a-53123f29d8ad tempest-ProjectMemberTests-1072060943 None] Creating offline snapshot 68399375-2db5-4ac9-b9db-3b8080055542 of volume 77e64051-b047-45d1-b6eb-c214e82dc103 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:25:26 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39c4482-c3a7-40f9-983d-2c917a24c9aa]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-117f3453-45f5-4d94-a11a-53123f29d8ad tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:26 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103 Sep 01 12:25:26 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:27 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-117f3453-45f5-4d94-a11a-53123f29d8ad tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103" returned: 0 in 0.367s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-117f3453-45f5-4d94-a11a-53123f29d8ad tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.68399375-2db5-4ac9-b9db-3b8080055542 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:27 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.68399375-2db5-4ac9-b9db-3b8080055542 1G Sep 01 12:25:27 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:27 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-117f3453-45f5-4d94-a11a-53123f29d8ad tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.68399375-2db5-4ac9-b9db-3b8080055542 1G" returned: 0 in 0.426s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-117f3453-45f5-4d94-a11a-53123f29d8ad tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e64051-b047-45d1-b6eb-c214e82dc103 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.68399375-2db5-4ac9-b9db-3b8080055542 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:27 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e64051-b047-45d1-b6eb-c214e82dc103 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.68399375-2db5-4ac9-b9db-3b8080055542 Sep 01 12:25:27 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:27 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-117f3453-45f5-4d94-a11a-53123f29d8ad tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e64051-b047-45d1-b6eb-c214e82dc103 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.68399375-2db5-4ac9-b9db-3b8080055542" returned: 0 in 0.302s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:27 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-117f3453-45f5-4d94-a11a-53123f29d8ad tempest-ProjectMemberTests-1072060943 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.68399375-2db5-4ac9-b9db-3b8080055542 is being set with open permissions: ugo+rw Sep 01 12:25:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-117f3453-45f5-4d94-a11a-53123f29d8ad tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.68399375-2db5-4ac9-b9db-3b8080055542 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:27 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.68399375-2db5-4ac9-b9db-3b8080055542 Sep 01 12:25:27 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:28 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-117f3453-45f5-4d94-a11a-53123f29d8ad tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.68399375-2db5-4ac9-b9db-3b8080055542" returned: 0 in 0.257s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-117f3453-45f5-4d94-a11a-53123f29d8ad tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:28 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.info Sep 01 12:25:28 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:28 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-117f3453-45f5-4d94-a11a-53123f29d8ad tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.info" returned: 0 in 0.274s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:28 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-117f3453-45f5-4d94-a11a-53123f29d8ad tempest-ProjectMemberTests-1072060943 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.info is being set with open permissions: ugo+rw Sep 01 12:25:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-117f3453-45f5-4d94-a11a-53123f29d8ad tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:28 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.info Sep 01 12:25:28 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:28 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-117f3453-45f5-4d94-a11a-53123f29d8ad tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.info" returned: 0 in 0.289s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-117f3453-45f5-4d94-a11a-53123f29d8ad tempest-ProjectMemberTests-1072060943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.004s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:28 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-117f3453-45f5-4d94-a11a-53123f29d8ad tempest-ProjectMemberTests-1072060943 None] Create snapshot completed successfully Sep 01 12:25:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-68399375-2db5-4ac9-b9db-3b8080055542-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] Lock "cinder-68399375-2db5-4ac9-b9db-3b8080055542-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-77e64051-b047-45d1-b6eb-c214e82dc103" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-77e64051-b047-45d1-b6eb-c214e82dc103" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-68399375-2db5-4ac9-b9db-3b8080055542" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:30 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-68399375-2db5-4ac9-b9db-3b8080055542" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] Deleting offline snapshot 68399375-2db5-4ac9-b9db-3b8080055542 of volume 77e64051-b047-45d1-b6eb-c214e82dc103 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:25:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] snapshot_file for this snap is: volume-77e64051-b047-45d1-b6eb-c214e82dc103.68399375-2db5-4ac9-b9db-3b8080055542 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:25:30 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4cf1f6-0359-4177-9f4d-c83b5d3fa536]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.68399375-2db5-4ac9-b9db-3b8080055542 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:30 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.68399375-2db5-4ac9-b9db-3b8080055542 Sep 01 12:25:30 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:30 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.68399375-2db5-4ac9-b9db-3b8080055542" returned: 0 in 0.363s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:30 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77e64051-b047-45d1-b6eb-c214e82dc103(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:25:30 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[be489b40-bd12-48fb-93d4-026a5eeb8f72]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:30 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:30 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103 Sep 01 12:25:30 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:31 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103" returned: 0 in 0.389s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.68399375-2db5-4ac9-b9db-3b8080055542 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:31 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.68399375-2db5-4ac9-b9db-3b8080055542 Sep 01 12:25:31 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=197,cinder:INSERT=54,cinder:UPDATE=227,cinder:DELETE=17 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Flow 'volume_create_manager' (4220ebd1-bfe2-40bc-8742-c853ba07e55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0202768b-d37a-45ee-949c-35d855c5f921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0202768b-d37a-45ee-949c-35d855c5f921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1304158900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='325433a85a6d4183b28b65a27f77b7a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:25:31Z,use_quota=True,user_id='7ec31d43d12a461a90c893903d0a70f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f685e361-c0e1-4e64-9646-97e3c647f4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f685e361-c0e1-4e64-9646-97e3c647f4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827c7a61-baf3-4435-a62c-f092a59051c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827c7a61-baf3-4435-a62c-f092a59051c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8', 'volume_name': 'volume-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa19640-3d24-4b5c-bc7f-337578941772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa19640-3d24-4b5c-bc7f-337578941772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a60ec6-4e6a-4207-932a-eb535fecd061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:31 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Volume 3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8', 'volume_size': 1} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1304158900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='325433a85a6d4183b28b65a27f77b7a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:25:31Z,use_quota=True,user_id='7ec31d43d12a461a90c893903d0a70f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Creating volume 3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:25:31 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:31 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8 1073741824 Sep 01 12:25:31 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:31 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.68399375-2db5-4ac9-b9db-3b8080055542" returned: 0 in 0.346s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.68399375-2db5-4ac9-b9db-3b8080055542 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:31 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.68399375-2db5-4ac9-b9db-3b8080055542 Sep 01 12:25:31 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:31 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103.68399375-2db5-4ac9-b9db-3b8080055542" returned: 0 in 0.261s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:31 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8 1073741824" returned: 0 in 0.417s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-68399375-2db5-4ac9-b9db-3b8080055542" released by "_delete_snapshot" :: held 1.457s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-77e64051-b047-45d1-b6eb-c214e82dc103" released by "delete_snapshot" :: held 1.489s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:31 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8 Sep 01 12:25:31 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] Created reservations ['96771dbc-af14-4c5f-bc1e-18c79a54db27', 'f3a05cff-0c60-4bca-b119-a61e62d0c8cc', 'f226a269-cb2d-4b08-b9b7-a573b97f5950', '73d521f9-70b3-41a8-8320-ed043f131e5d'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:25:31 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] Delete snapshot completed successfully. Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-c2218fc5-be77-4cb6-9ee8-895cf2d6f00a tempest-ProjectMemberTests-1072060943 None] Lock "cinder-68399375-2db5-4ac9-b9db-3b8080055542-delete_snapshot" released by "delete_snapshot" :: held 1.646s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:31 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8" returned: 0 in 0.255s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a60ec6-4e6a-4207-932a-eb535fecd061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a31623-97fd-4016-a989-7eb0c413defc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:31 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Volume volume-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8 (3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8): created successfully Sep 01 12:25:31 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a31623-97fd-4016-a989-7eb0c413defc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:32 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Flow 'volume_create_manager' (4220ebd1-bfe2-40bc-8742-c853ba07e55d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:25:32 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-ce8551bf-cc11-4bad-ac28-eb6f96f9c03a tempest-ProjectReaderTests-435885494 None] Created volume successfully. Sep 01 12:25:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-89e3e349-9e17-450f-b57b-cdbfe657006f tempest-ProjectReaderTests-435885494 None] Acquiring lock "cinder-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-89e3e349-9e17-450f-b57b-cdbfe657006f tempest-ProjectReaderTests-435885494 None] Lock "cinder-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0e4d1d51-751c-4108-8c1e-cd244049230e tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-77e64051-b047-45d1-b6eb-c214e82dc103-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-89e3e349-9e17-450f-b57b-cdbfe657006f tempest-ProjectReaderTests-435885494 None] Acquiring lock "cinder-quobyte-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0e4d1d51-751c-4108-8c1e-cd244049230e tempest-ProjectMemberTests-1072060943 None] Lock "cinder-77e64051-b047-45d1-b6eb-c214e82dc103-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-89e3e349-9e17-450f-b57b-cdbfe657006f tempest-ProjectReaderTests-435885494 None] Lock "cinder-quobyte-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:32 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ed0de4-a482-4497-9cdb-552add2f3bde]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-89e3e349-9e17-450f-b57b-cdbfe657006f tempest-ProjectReaderTests-435885494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0e4d1d51-751c-4108-8c1e-cd244049230e tempest-ProjectMemberTests-1072060943 None] Acquiring lock "cinder-quobyte-77e64051-b047-45d1-b6eb-c214e82dc103" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:32 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0e4d1d51-751c-4108-8c1e-cd244049230e tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-77e64051-b047-45d1-b6eb-c214e82dc103" acquired by "delete_volume" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:32 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc0dab6-19c6-48da-8358-23d5a2f468b4]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0e4d1d51-751c-4108-8c1e-cd244049230e tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:32 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8 Sep 01 12:25:32 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:32 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103 Sep 01 12:25:32 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:32 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-89e3e349-9e17-450f-b57b-cdbfe657006f tempest-ProjectReaderTests-435885494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8" returned: 0 in 0.357s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-89e3e349-9e17-450f-b57b-cdbfe657006f tempest-ProjectReaderTests-435885494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:32 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8 Sep 01 12:25:32 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:32 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0e4d1d51-751c-4108-8c1e-cd244049230e tempest-ProjectMemberTests-1072060943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103" returned: 0 in 0.355s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:32 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0e4d1d51-751c-4108-8c1e-cd244049230e tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:32 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103 Sep 01 12:25:32 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:33 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-89e3e349-9e17-450f-b57b-cdbfe657006f tempest-ProjectReaderTests-435885494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8" returned: 0 in 0.238s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-89e3e349-9e17-450f-b57b-cdbfe657006f tempest-ProjectReaderTests-435885494 None] Lock "cinder-quobyte-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8" released by "delete_volume" :: held 0.643s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-89e3e349-9e17-450f-b57b-cdbfe657006f tempest-ProjectReaderTests-435885494 None] Created reservations ['9fcc38b6-f3f8-40b7-8792-9d35b92a6693', '9f44ec97-4606-45d2-ac80-4a97ab10da66', '72b81859-7fee-458b-a365-0622dfb6e104', 'bba6bca5-e882-4e07-b891-9f4cb546620d'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:25:33 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0e4d1d51-751c-4108-8c1e-cd244049230e tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-77e64051-b047-45d1-b6eb-c214e82dc103" returned: 0 in 0.246s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0e4d1d51-751c-4108-8c1e-cd244049230e tempest-ProjectMemberTests-1072060943 None] Lock "cinder-quobyte-77e64051-b047-45d1-b6eb-c214e82dc103" released by "delete_volume" :: held 0.659s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-89e3e349-9e17-450f-b57b-cdbfe657006f tempest-ProjectReaderTests-435885494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-89e3e349-9e17-450f-b57b-cdbfe657006f tempest-ProjectReaderTests-435885494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-89e3e349-9e17-450f-b57b-cdbfe657006f tempest-ProjectReaderTests-435885494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-89e3e349-9e17-450f-b57b-cdbfe657006f tempest-ProjectReaderTests-435885494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-89e3e349-9e17-450f-b57b-cdbfe657006f tempest-ProjectReaderTests-435885494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-89e3e349-9e17-450f-b57b-cdbfe657006f tempest-ProjectReaderTests-435885494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:33 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:25:33 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-0e4d1d51-751c-4108-8c1e-cd244049230e tempest-ProjectMemberTests-1072060943 None] Created reservations ['634c8fa1-8a0c-4c83-b03a-8a30a6240850', 'eb445c4e-4230-4880-b7fd-44cb59ed3c0a', '2844d549-de2e-4a42-9610-515bef10cc13', 'd43ee092-35f8-4a79-b473-080e955976bf'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0e4d1d51-751c-4108-8c1e-cd244049230e tempest-ProjectMemberTests-1072060943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0e4d1d51-751c-4108-8c1e-cd244049230e tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0e4d1d51-751c-4108-8c1e-cd244049230e tempest-ProjectMemberTests-1072060943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-0e4d1d51-751c-4108-8c1e-cd244049230e tempest-ProjectMemberTests-1072060943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-0e4d1d51-751c-4108-8c1e-cd244049230e tempest-ProjectMemberTests-1072060943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0e4d1d51-751c-4108-8c1e-cd244049230e tempest-ProjectMemberTests-1072060943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:33 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:25:33 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:33 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-89e3e349-9e17-450f-b57b-cdbfe657006f tempest-ProjectReaderTests-435885494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.264s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-89e3e349-9e17-450f-b57b-cdbfe657006f tempest-ProjectReaderTests-435885494 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:25:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-89e3e349-9e17-450f-b57b-cdbfe657006f tempest-ProjectReaderTests-435885494 None] Deleted volume successfully. Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-89e3e349-9e17-450f-b57b-cdbfe657006f tempest-ProjectReaderTests-435885494 None] Lock "cinder-3dd4990b-4b95-4e3f-9ccb-50e7be86dfb8-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:33 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-0e4d1d51-751c-4108-8c1e-cd244049230e tempest-ProjectMemberTests-1072060943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.267s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-0e4d1d51-751c-4108-8c1e-cd244049230e tempest-ProjectMemberTests-1072060943 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:25:33 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-0e4d1d51-751c-4108-8c1e-cd244049230e tempest-ProjectMemberTests-1072060943 None] Deleted volume successfully. Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-0e4d1d51-751c-4108-8c1e-cd244049230e tempest-ProjectMemberTests-1072060943 None] Lock "cinder-77e64051-b047-45d1-b6eb-c214e82dc103-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Flow 'volume_create_manager' (f2f663c5-54d9-4b31-8ce7-a061eb7fdcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:25:33 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b94f06-9d6f-4d0b-9806-b2204990b7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b94f06-9d6f-4d0b-9806-b2204990b7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-870001492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73afa40a-59b7-449c-866b-8ddf3219247c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='325433a85a6d4183b28b65a27f77b7a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:25:34Z,use_quota=True,user_id='7ec31d43d12a461a90c893903d0a70f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5095c9ee-61d8-46ea-aead-248f5e277ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5095c9ee-61d8-46ea-aead-248f5e277ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (804e593d-2ff7-4e51-adbf-be58e77674c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (804e593d-2ff7-4e51-adbf-be58e77674c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73afa40a-59b7-449c-866b-8ddf3219247c', 'volume_name': 'volume-73afa40a-59b7-449c-866b-8ddf3219247c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d89530-d001-437d-bab2-cf6f60792768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d89530-d001-437d-bab2-cf6f60792768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb80e35d-2939-4917-87f5-71521c5e2b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:34 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Volume 73afa40a-59b7-449c-866b-8ddf3219247c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73afa40a-59b7-449c-866b-8ddf3219247c', 'volume_size': 1} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-870001492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73afa40a-59b7-449c-866b-8ddf3219247c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='325433a85a6d4183b28b65a27f77b7a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:25:34Z,use_quota=True,user_id='7ec31d43d12a461a90c893903d0a70f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Creating volume 73afa40a-59b7-449c-866b-8ddf3219247c {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:25:34 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-73afa40a-59b7-449c-866b-8ddf3219247c 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:34 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-73afa40a-59b7-449c-866b-8ddf3219247c 1073741824 Sep 01 12:25:34 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:34 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-73afa40a-59b7-449c-866b-8ddf3219247c 1073741824" returned: 0 in 0.444s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-73afa40a-59b7-449c-866b-8ddf3219247c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:34 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-73afa40a-59b7-449c-866b-8ddf3219247c Sep 01 12:25:34 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:34 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-73afa40a-59b7-449c-866b-8ddf3219247c" returned: 0 in 0.240s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb80e35d-2939-4917-87f5-71521c5e2b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73afa40a-59b7-449c-866b-8ddf3219247c', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106678eb-4cb4-493a-9884-3b6c17a33a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:34 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Volume volume-73afa40a-59b7-449c-866b-8ddf3219247c (73afa40a-59b7-449c-866b-8ddf3219247c): created successfully Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106678eb-4cb4-493a-9884-3b6c17a33a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:34 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Flow 'volume_create_manager' (f2f663c5-54d9-4b31-8ce7-a061eb7fdcca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:25:34 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-5da61c03-5d4c-4766-b9d1-067785b718b9 tempest-ProjectReaderTests-435885494 None] Created volume successfully. Sep 01 12:25:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-23ac3ab7-8222-46c2-8464-f3376ed7b728 tempest-ProjectReaderTests-435885494 None] Acquiring lock "cinder-73afa40a-59b7-449c-866b-8ddf3219247c-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-23ac3ab7-8222-46c2-8464-f3376ed7b728 tempest-ProjectReaderTests-435885494 None] Lock "cinder-73afa40a-59b7-449c-866b-8ddf3219247c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-23ac3ab7-8222-46c2-8464-f3376ed7b728 tempest-ProjectReaderTests-435885494 None] Acquiring lock "cinder-quobyte-73afa40a-59b7-449c-866b-8ddf3219247c" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-23ac3ab7-8222-46c2-8464-f3376ed7b728 tempest-ProjectReaderTests-435885494 None] Lock "cinder-quobyte-73afa40a-59b7-449c-866b-8ddf3219247c" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:35 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[575be320-cd15-4b34-a428-384802daa4bb]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-23ac3ab7-8222-46c2-8464-f3376ed7b728 tempest-ProjectReaderTests-435885494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-73afa40a-59b7-449c-866b-8ddf3219247c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:35 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-73afa40a-59b7-449c-866b-8ddf3219247c Sep 01 12:25:35 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:35 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-23ac3ab7-8222-46c2-8464-f3376ed7b728 tempest-ProjectReaderTests-435885494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-73afa40a-59b7-449c-866b-8ddf3219247c" returned: 0 in 0.359s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-23ac3ab7-8222-46c2-8464-f3376ed7b728 tempest-ProjectReaderTests-435885494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-73afa40a-59b7-449c-866b-8ddf3219247c {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:35 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-73afa40a-59b7-449c-866b-8ddf3219247c Sep 01 12:25:35 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:35 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-23ac3ab7-8222-46c2-8464-f3376ed7b728 tempest-ProjectReaderTests-435885494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-73afa40a-59b7-449c-866b-8ddf3219247c" returned: 0 in 0.249s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:35 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-23ac3ab7-8222-46c2-8464-f3376ed7b728 tempest-ProjectReaderTests-435885494 None] Lock "cinder-quobyte-73afa40a-59b7-449c-866b-8ddf3219247c" released by "delete_volume" :: held 0.654s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:35 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-23ac3ab7-8222-46c2-8464-f3376ed7b728 tempest-ProjectReaderTests-435885494 None] Created reservations ['3d9cd867-5f87-4d21-8aa2-5d93c3316732', '2e7fb0a5-0921-42c6-b4db-2fb6f0d8334c', '26a479f1-3f26-46d9-b49d-24c614d9b19d', '26e09979-122f-40dd-8d76-a6c6eeb74303'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:25:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-23ac3ab7-8222-46c2-8464-f3376ed7b728 tempest-ProjectReaderTests-435885494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-23ac3ab7-8222-46c2-8464-f3376ed7b728 tempest-ProjectReaderTests-435885494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-23ac3ab7-8222-46c2-8464-f3376ed7b728 tempest-ProjectReaderTests-435885494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:35 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-23ac3ab7-8222-46c2-8464-f3376ed7b728 tempest-ProjectReaderTests-435885494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-23ac3ab7-8222-46c2-8464-f3376ed7b728 tempest-ProjectReaderTests-435885494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:35 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-23ac3ab7-8222-46c2-8464-f3376ed7b728 tempest-ProjectReaderTests-435885494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:35 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:25:35 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:36 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-23ac3ab7-8222-46c2-8464-f3376ed7b728 tempest-ProjectReaderTests-435885494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.273s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-23ac3ab7-8222-46c2-8464-f3376ed7b728 tempest-ProjectReaderTests-435885494 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:25:36 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-23ac3ab7-8222-46c2-8464-f3376ed7b728 tempest-ProjectReaderTests-435885494 None] Deleted volume successfully. Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-23ac3ab7-8222-46c2-8464-f3376ed7b728 tempest-ProjectReaderTests-435885494 None] Lock "cinder-73afa40a-59b7-449c-866b-8ddf3219247c-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Flow 'volume_create_manager' (2295674e-c41c-4186-bf5b-1812996a3d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee3db9f-3164-4870-9634-92c647de43fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee3db9f-3164-4870-9634-92c647de43fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484456163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9b4088-0135-4bf9-966c-02e8e35ed831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='325433a85a6d4183b28b65a27f77b7a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:25:37Z,use_quota=True,user_id='7ec31d43d12a461a90c893903d0a70f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8105af10-b77c-4c5a-a353-54f85846fc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8105af10-b77c-4c5a-a353-54f85846fc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e12081a7-395e-4e69-93f9-6f7fd34faaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e12081a7-395e-4e69-93f9-6f7fd34faaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d9b4088-0135-4bf9-966c-02e8e35ed831', 'volume_name': 'volume-5d9b4088-0135-4bf9-966c-02e8e35ed831', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2209158d-c4f9-4d95-a39a-3442fae4fbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2209158d-c4f9-4d95-a39a-3442fae4fbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff8a206-e047-4b86-97a2-edff8750e13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:36 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Volume 5d9b4088-0135-4bf9-966c-02e8e35ed831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d9b4088-0135-4bf9-966c-02e8e35ed831', 'volume_size': 1} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484456163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9b4088-0135-4bf9-966c-02e8e35ed831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='325433a85a6d4183b28b65a27f77b7a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:25:37Z,use_quota=True,user_id='7ec31d43d12a461a90c893903d0a70f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Creating volume 5d9b4088-0135-4bf9-966c-02e8e35ed831 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:25:36 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:25:36 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5d9b4088-0135-4bf9-966c-02e8e35ed831 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:36 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5d9b4088-0135-4bf9-966c-02e8e35ed831 1073741824 Sep 01 12:25:36 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:37 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5d9b4088-0135-4bf9-966c-02e8e35ed831 1073741824" returned: 0 in 0.413s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5d9b4088-0135-4bf9-966c-02e8e35ed831 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:37 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5d9b4088-0135-4bf9-966c-02e8e35ed831 Sep 01 12:25:37 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:37 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5d9b4088-0135-4bf9-966c-02e8e35ed831" returned: 0 in 0.230s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:37 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:25:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff8a206-e047-4b86-97a2-edff8750e13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d9b4088-0135-4bf9-966c-02e8e35ed831', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f840fd87-8fb3-4013-96bb-68f4a12f4e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:37 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Volume volume-5d9b4088-0135-4bf9-966c-02e8e35ed831 (5d9b4088-0135-4bf9-966c-02e8e35ed831): created successfully Sep 01 12:25:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f840fd87-8fb3-4013-96bb-68f4a12f4e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:37 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Flow 'volume_create_manager' (2295674e-c41c-4186-bf5b-1812996a3d64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:25:37 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-61b1f4c2-958d-46d6-be90-133f217e34b8 tempest-ProjectReaderTests-435885494 None] Created volume successfully. Sep 01 12:25:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9d354d56-9e33-4ed2-8051-6978903a958f tempest-ProjectReaderTests-435885494 None] Acquiring lock "cinder-5d9b4088-0135-4bf9-966c-02e8e35ed831-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9d354d56-9e33-4ed2-8051-6978903a958f tempest-ProjectReaderTests-435885494 None] Lock "cinder-5d9b4088-0135-4bf9-966c-02e8e35ed831-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9d354d56-9e33-4ed2-8051-6978903a958f tempest-ProjectReaderTests-435885494 None] Acquiring lock "cinder-quobyte-5d9b4088-0135-4bf9-966c-02e8e35ed831" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:37 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9d354d56-9e33-4ed2-8051-6978903a958f tempest-ProjectReaderTests-435885494 None] Lock "cinder-quobyte-5d9b4088-0135-4bf9-966c-02e8e35ed831" acquired by "delete_volume" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:37 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a7ad87-c139-4fda-9b59-5a8ec755e647]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:37 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d354d56-9e33-4ed2-8051-6978903a958f tempest-ProjectReaderTests-435885494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5d9b4088-0135-4bf9-966c-02e8e35ed831 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:37 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5d9b4088-0135-4bf9-966c-02e8e35ed831 Sep 01 12:25:37 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:38 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d354d56-9e33-4ed2-8051-6978903a958f tempest-ProjectReaderTests-435885494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5d9b4088-0135-4bf9-966c-02e8e35ed831" returned: 0 in 0.373s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d354d56-9e33-4ed2-8051-6978903a958f tempest-ProjectReaderTests-435885494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5d9b4088-0135-4bf9-966c-02e8e35ed831 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:38 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5d9b4088-0135-4bf9-966c-02e8e35ed831 Sep 01 12:25:38 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:38 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d354d56-9e33-4ed2-8051-6978903a958f tempest-ProjectReaderTests-435885494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-5d9b4088-0135-4bf9-966c-02e8e35ed831" returned: 0 in 0.251s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9d354d56-9e33-4ed2-8051-6978903a958f tempest-ProjectReaderTests-435885494 None] Lock "cinder-quobyte-5d9b4088-0135-4bf9-966c-02e8e35ed831" released by "delete_volume" :: held 0.678s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:38 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-9d354d56-9e33-4ed2-8051-6978903a958f tempest-ProjectReaderTests-435885494 None] Created reservations ['74922a2a-59ae-42f4-ac91-b0d28b9cb422', '1ff53726-52c1-430a-83eb-ba1268f4a785', '5c32fd6a-76a5-4112-92dc-50352cfab665', '1bef2c16-2cda-4906-84a8-46c99cdccea5'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:25:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9d354d56-9e33-4ed2-8051-6978903a958f tempest-ProjectReaderTests-435885494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9d354d56-9e33-4ed2-8051-6978903a958f tempest-ProjectReaderTests-435885494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9d354d56-9e33-4ed2-8051-6978903a958f tempest-ProjectReaderTests-435885494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:38 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-9d354d56-9e33-4ed2-8051-6978903a958f tempest-ProjectReaderTests-435885494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-9d354d56-9e33-4ed2-8051-6978903a958f tempest-ProjectReaderTests-435885494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d354d56-9e33-4ed2-8051-6978903a958f tempest-ProjectReaderTests-435885494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:38 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:25:38 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:38 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:38 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-9d354d56-9e33-4ed2-8051-6978903a958f tempest-ProjectReaderTests-435885494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.253s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:38 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-9d354d56-9e33-4ed2-8051-6978903a958f tempest-ProjectReaderTests-435885494 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:25:38 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-9d354d56-9e33-4ed2-8051-6978903a958f tempest-ProjectReaderTests-435885494 None] Deleted volume successfully. Sep 01 12:25:38 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-9d354d56-9e33-4ed2-8051-6978903a958f tempest-ProjectReaderTests-435885494 None] Lock "cinder-5d9b4088-0135-4bf9-966c-02e8e35ed831-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Flow 'volume_create_manager' (5ca9a4a7-dbbe-4962-b5b5-f4ce6eab0811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3188b2c0-fb5b-4fd0-ba14-4e0427b1cbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=273,cinder:SELECT=178,cinder:INSERT=82,cinder:DELETE=25 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3188b2c0-fb5b-4fd0-ba14-4e0427b1cbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1808198937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac43142-8982-4549-b2dd-121e1f55c705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='325433a85a6d4183b28b65a27f77b7a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:25:39Z,use_quota=True,user_id='7ec31d43d12a461a90c893903d0a70f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0713a6fe-3e2b-46b2-a80a-d3476087f349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0713a6fe-3e2b-46b2-a80a-d3476087f349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8faaf649-eb19-4f62-8ebb-bd5c99c81523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8faaf649-eb19-4f62-8ebb-bd5c99c81523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac43142-8982-4549-b2dd-121e1f55c705', 'volume_name': 'volume-fac43142-8982-4549-b2dd-121e1f55c705', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c315ac-b8b0-4fff-beb0-f90f868346c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c315ac-b8b0-4fff-beb0-f90f868346c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ea7e06-c0b6-4592-8d5d-0a445a5f256c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:39 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Volume fac43142-8982-4549-b2dd-121e1f55c705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac43142-8982-4549-b2dd-121e1f55c705', 'volume_size': 1} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1808198937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac43142-8982-4549-b2dd-121e1f55c705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='325433a85a6d4183b28b65a27f77b7a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:25:39Z,use_quota=True,user_id='7ec31d43d12a461a90c893903d0a70f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Creating volume fac43142-8982-4549-b2dd-121e1f55c705 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:25:39 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-fac43142-8982-4549-b2dd-121e1f55c705 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:39 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-fac43142-8982-4549-b2dd-121e1f55c705 1073741824 Sep 01 12:25:39 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:39 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-fac43142-8982-4549-b2dd-121e1f55c705 1073741824" returned: 0 in 0.413s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:39 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-fac43142-8982-4549-b2dd-121e1f55c705 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:39 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-fac43142-8982-4549-b2dd-121e1f55c705 Sep 01 12:25:39 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:40 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-fac43142-8982-4549-b2dd-121e1f55c705" returned: 0 in 0.262s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:40 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:25:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ea7e06-c0b6-4592-8d5d-0a445a5f256c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac43142-8982-4549-b2dd-121e1f55c705', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515dfd3f-7e75-4d52-9903-b67eaf5ec572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:25:40 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Volume volume-fac43142-8982-4549-b2dd-121e1f55c705 (fac43142-8982-4549-b2dd-121e1f55c705): created successfully Sep 01 12:25:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515dfd3f-7e75-4d52-9903-b67eaf5ec572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:25:40 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Flow 'volume_create_manager' (5ca9a4a7-dbbe-4962-b5b5-f4ce6eab0811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:25:40 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-36121218-0530-4fcb-984d-0984da5560d3 tempest-ProjectReaderTests-435885494 None] Created volume successfully. Sep 01 12:25:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b82106af-6876-460e-83e6-27ae823482dc tempest-ProjectReaderTests-435885494 None] Acquiring lock "cinder-fac43142-8982-4549-b2dd-121e1f55c705-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b82106af-6876-460e-83e6-27ae823482dc tempest-ProjectReaderTests-435885494 None] Lock "cinder-fac43142-8982-4549-b2dd-121e1f55c705-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b82106af-6876-460e-83e6-27ae823482dc tempest-ProjectReaderTests-435885494 None] Acquiring lock "cinder-quobyte-fac43142-8982-4549-b2dd-121e1f55c705" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:25:40 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b82106af-6876-460e-83e6-27ae823482dc tempest-ProjectReaderTests-435885494 None] Lock "cinder-quobyte-fac43142-8982-4549-b2dd-121e1f55c705" acquired by "delete_volume" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:25:40 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[1508094c-bd76-46b8-98d8-538838b26ba3]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:25:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b82106af-6876-460e-83e6-27ae823482dc tempest-ProjectReaderTests-435885494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-fac43142-8982-4549-b2dd-121e1f55c705 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:40 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-fac43142-8982-4549-b2dd-121e1f55c705 Sep 01 12:25:40 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:40 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b82106af-6876-460e-83e6-27ae823482dc tempest-ProjectReaderTests-435885494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-fac43142-8982-4549-b2dd-121e1f55c705" returned: 0 in 0.357s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:40 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b82106af-6876-460e-83e6-27ae823482dc tempest-ProjectReaderTests-435885494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-fac43142-8982-4549-b2dd-121e1f55c705 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:40 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-fac43142-8982-4549-b2dd-121e1f55c705 Sep 01 12:25:40 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:41 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b82106af-6876-460e-83e6-27ae823482dc tempest-ProjectReaderTests-435885494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-fac43142-8982-4549-b2dd-121e1f55c705" returned: 0 in 0.233s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b82106af-6876-460e-83e6-27ae823482dc tempest-ProjectReaderTests-435885494 None] Lock "cinder-quobyte-fac43142-8982-4549-b2dd-121e1f55c705" released by "delete_volume" :: held 0.639s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:41 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-b82106af-6876-460e-83e6-27ae823482dc tempest-ProjectReaderTests-435885494 None] Created reservations ['df2f292f-2a87-4990-9c0e-ae9c6bce3261', 'c82cda60-e3ee-49cc-b22e-c1c87a304427', 'b05743b7-7497-4537-b6ee-5c326d7d6319', 'fcb5e385-5709-4c89-a497-3967b4a3cb6d'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:25:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b82106af-6876-460e-83e6-27ae823482dc tempest-ProjectReaderTests-435885494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b82106af-6876-460e-83e6-27ae823482dc tempest-ProjectReaderTests-435885494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b82106af-6876-460e-83e6-27ae823482dc tempest-ProjectReaderTests-435885494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b82106af-6876-460e-83e6-27ae823482dc tempest-ProjectReaderTests-435885494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b82106af-6876-460e-83e6-27ae823482dc tempest-ProjectReaderTests-435885494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b82106af-6876-460e-83e6-27ae823482dc tempest-ProjectReaderTests-435885494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:41 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:25:41 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:41 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b82106af-6876-460e-83e6-27ae823482dc tempest-ProjectReaderTests-435885494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.227s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:41 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b82106af-6876-460e-83e6-27ae823482dc tempest-ProjectReaderTests-435885494 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:25:41 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-b82106af-6876-460e-83e6-27ae823482dc tempest-ProjectReaderTests-435885494 None] Deleted volume successfully. Sep 01 12:25:41 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-b82106af-6876-460e-83e6-27ae823482dc tempest-ProjectReaderTests-435885494 None] Lock "cinder-fac43142-8982-4549-b2dd-121e1f55c705-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:25:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:25:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:25:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:25:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:25:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:25:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:25:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:25:41 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:25:41 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:25:42 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Sep 01 12:25:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.263s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:25:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:25:42 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:25:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:25:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:25:51 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:25:51 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=39,cinder:UPDATE=61,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:26:05 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:26:05 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=1 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Flow 'volume_create_manager' (355d71f1-8f35-4810-90ba-66f3a16bd769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677d015e-a06b-4853-82eb-7d88f106407e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677d015e-a06b-4853-82eb-7d88f106407e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-453787705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc1123f-d7a1-4fd5-961c-284269087b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af33552eba984d31b8c7e08c41828a0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:26:15Z,use_quota=True,user_id='aef48fa303c04c7f83683daf64c94acd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bfbe096-003e-469d-9464-2f63d0e78ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bfbe096-003e-469d-9464-2f63d0e78ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe4d592-cf53-4ed6-974d-6f9a33b94cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe4d592-cf53-4ed6-974d-6f9a33b94cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bc1123f-d7a1-4fd5-961c-284269087b77', 'volume_name': 'volume-2bc1123f-d7a1-4fd5-961c-284269087b77', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40810ce5-00fb-4f92-9fd8-1c0bd174dafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40810ce5-00fb-4f92-9fd8-1c0bd174dafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db511b78-30dc-4eb3-a444-e3f51533d65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:26:15 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Volume 2bc1123f-d7a1-4fd5-961c-284269087b77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bc1123f-d7a1-4fd5-961c-284269087b77', 'volume_size': 1} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-453787705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc1123f-d7a1-4fd5-961c-284269087b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af33552eba984d31b8c7e08c41828a0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:26:15Z,use_quota=True,user_id='aef48fa303c04c7f83683daf64c94acd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)}" {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Creating volume 2bc1123f-d7a1-4fd5-961c-284269087b77 {{(pid=87084) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:26:15 devstack cinder-volume[87084]: INFO cinder.volume.drivers.remotefs [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] casted to osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77 1073741824 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:15 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77 1073741824 Sep 01 12:26:15 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:15 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77 1073741824" returned: 0 in 0.391s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:15 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77 Sep 01 12:26:15 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:15 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77" returned: 0 in 0.237s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'} {{(pid=87084) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:26:15 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:26:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db511b78-30dc-4eb3-a444-e3f51533d65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc1123f-d7a1-4fd5-961c-284269087b77', 'volume_size': 1}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:26:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2180e467-9d27-4422-a165-54be66913736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:26:16 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Volume volume-2bc1123f-d7a1-4fd5-961c-284269087b77 (2bc1123f-d7a1-4fd5-961c-284269087b77): created successfully Sep 01 12:26:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2180e467-9d27-4422-a165-54be66913736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:26:16 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Flow 'volume_create_manager' (355d71f1-8f35-4810-90ba-66f3a16bd769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:26:16 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c49f6867-0417-4bef-95b5-8573ff2091ae tempest-SnapshotDependencyTests-1346583661 None] Created volume successfully. Sep 01 12:26:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5da81ea-7158-413b-8fbd-86f76db0586c tempest-SnapshotDependencyTests-1346583661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:26:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5da81ea-7158-413b-8fbd-86f76db0586c tempest-SnapshotDependencyTests-1346583661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:26:16 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-c5da81ea-7158-413b-8fbd-86f76db0586c tempest-SnapshotDependencyTests-1346583661 None] Creating offline snapshot 0dc87abe-2ce1-4176-befe-e1423c0f3d30 of volume 2bc1123f-d7a1-4fd5-961c-284269087b77 {{(pid=87084) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:26:16 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[783a39bd-13dc-4b7f-b03f-61defd98709e]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:26:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5da81ea-7158-413b-8fbd-86f76db0586c tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:16 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77 Sep 01 12:26:16 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:16 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5da81ea-7158-413b-8fbd-86f76db0586c tempest-SnapshotDependencyTests-1346583661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77" returned: 0 in 0.331s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:16 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5da81ea-7158-413b-8fbd-86f76db0586c tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30 1G {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:16 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30 1G Sep 01 12:26:16 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:17 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5da81ea-7158-413b-8fbd-86f76db0586c tempest-SnapshotDependencyTests-1346583661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30 1G" returned: 0 in 0.410s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5da81ea-7158-413b-8fbd-86f76db0586c tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bc1123f-d7a1-4fd5-961c-284269087b77 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:17 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bc1123f-d7a1-4fd5-961c-284269087b77 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30 Sep 01 12:26:17 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:17 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5da81ea-7158-413b-8fbd-86f76db0586c tempest-SnapshotDependencyTests-1346583661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bc1123f-d7a1-4fd5-961c-284269087b77 -F qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30" returned: 0 in 0.281s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:17 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-c5da81ea-7158-413b-8fbd-86f76db0586c tempest-SnapshotDependencyTests-1346583661 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30 is being set with open permissions: ugo+rw Sep 01 12:26:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5da81ea-7158-413b-8fbd-86f76db0586c tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:17 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30 Sep 01 12:26:17 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:17 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5da81ea-7158-413b-8fbd-86f76db0586c tempest-SnapshotDependencyTests-1346583661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30" returned: 0 in 0.227s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:17 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5da81ea-7158-413b-8fbd-86f76db0586c tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:17 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.info Sep 01 12:26:17 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:18 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5da81ea-7158-413b-8fbd-86f76db0586c tempest-SnapshotDependencyTests-1346583661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.info" returned: 0 in 0.236s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:18 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-c5da81ea-7158-413b-8fbd-86f76db0586c tempest-SnapshotDependencyTests-1346583661 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.info is being set with open permissions: ugo+rw Sep 01 12:26:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5da81ea-7158-413b-8fbd-86f76db0586c tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.info {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:18 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.info Sep 01 12:26:18 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:18 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-c5da81ea-7158-413b-8fbd-86f76db0586c tempest-SnapshotDependencyTests-1346583661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.info" returned: 0 in 0.223s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:18 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-c5da81ea-7158-413b-8fbd-86f76db0586c tempest-SnapshotDependencyTests-1346583661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.787s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:26:18 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-c5da81ea-7158-413b-8fbd-86f76db0586c tempest-SnapshotDependencyTests-1346583661 None] Create snapshot completed successfully Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.volume.flows.manager.create_volume [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87084) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Flow 'volume_create_manager' (5c85a1a1-056f-4a2b-90a8-9c9a811d7444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a6639e-610e-496c-bbc1-94d3bee9b370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a6639e-610e-496c-bbc1-94d3bee9b370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a66731b7-622e-4ace-844d-6b4d3ea207ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af33552eba984d31b8c7e08c41828a0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0dc87abe-2ce1-4176-befe-e1423c0f3d30,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:26:19Z,use_quota=True,user_id='aef48fa303c04c7f83683daf64c94acd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3921b0f3-343c-442f-a7a2-b7221123a3b7),volume_type_id=3921b0f3-343c-442f-a7a2-b7221123a3b7)' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d506018-319c-4176-a313-2596f66ce231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d506018-319c-4176-a313-2596f66ce231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ca45bb-bd12-49b2-b88b-e99eee37d1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ca45bb-bd12-49b2-b88b-e99eee37d1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a66731b7-622e-4ace-844d-6b4d3ea207ea', 'volume_name': 'volume-a66731b7-622e-4ace-844d-6b4d3ea207ea', 'volume_size': 1, 'snapshot_id': '0dc87abe-2ce1-4176-befe-e1423c0f3d30'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34128820-e9b9-4d8c-b9e4-f38050f8b817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34128820-e9b9-4d8c-b9e4-f38050f8b817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c51146c-7f79-4e01-98cd-da66ff2c9ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:26:19 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Volume a66731b7-622e-4ace-844d-6b4d3ea207ea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a66731b7-622e-4ace-844d-6b4d3ea207ea', 'volume_size': 1, 'snapshot_id': '0dc87abe-2ce1-4176-befe-e1423c0f3d30'} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Acquiring lock "cinder-quobyte-0dc87abe-2ce1-4176-befe-e1423c0f3d30-a66731b7-622e-4ace-844d-6b4d3ea207ea" by "_create_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Lock "cinder-quobyte-0dc87abe-2ce1-4176-befe-e1423c0f3d30-a66731b7-622e-4ace-844d-6b4d3ea207ea" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Creating volume a66731b7-622e-4ace-844d-6b4d3ea207ea from snapshot 0dc87abe-2ce1-4176-befe-e1423c0f3d30 {{(pid=87084) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Selected osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1 as target Quobyte volume. {{(pid=87084) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Acquiring lock "cinder-quobyte-a66731b7-622e-4ace-844d-6b4d3ea207ea" by "_copy_volume_from_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Lock "cinder-quobyte-a66731b7-622e-4ace-844d-6b4d3ea207ea" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] snapshot: 0dc87abe-2ce1-4176-befe-e1423c0f3d30, volume: a66731b7-622e-4ace-844d-6b4d3ea207ea, {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f0b064-f5b1-4534-98f8-46cfb6c1ebf1]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:19 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30 Sep 01 12:26:19 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:19 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30" returned: 0 in 0.330s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bc1123f-d7a1-4fd5-961c-284269087b77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f65101-4ed7-4737-9153-cedc8694fcd2]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:19 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77 Sep 01 12:26:19 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:19 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77" returned: 0 in 0.342s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77 {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Creating direct copy from snapshot {{(pid=87084) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG cinder.utils [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Path /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a66731b7-622e-4ace-844d-6b4d3ea207ea not found in is_blk_device check {{(pid=87084) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:26:19 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a66731b7-622e-4ace-844d-6b4d3ea207ea {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:19 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a66731b7-622e-4ace-844d-6b4d3ea207ea Sep 01 12:26:19 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:23 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a66731b7-622e-4ace-844d-6b4d3ea207ea" returned: 0 in 3.839s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:23 devstack cinder-volume[87084]: DEBUG cinder.image.image_utils [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Image conversion details: src /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77, size 1024.00 MB, duration 3.84 sec, destination /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a66731b7-622e-4ace-844d-6b4d3ea207ea {{(pid=87084) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:26:23 devstack cinder-volume[87084]: INFO cinder.image.image_utils [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Converted 1024.00 MB image at 266.63 MB/s Sep 01 12:26:23 devstack cinder-volume[87084]: WARNING cinder.volume.drivers.remotefs [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a66731b7-622e-4ace-844d-6b4d3ea207ea is being set with open permissions: ugo+rw Sep 01 12:26:23 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a66731b7-622e-4ace-844d-6b4d3ea207ea {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:23 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a66731b7-622e-4ace-844d-6b4d3ea207ea Sep 01 12:26:23 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:24 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a66731b7-622e-4ace-844d-6b4d3ea207ea" returned: 0 in 0.235s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Lock "cinder-quobyte-a66731b7-622e-4ace-844d-6b4d3ea207ea" released by "_copy_volume_from_snapshot" :: held 4.813s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:26:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Lock "cinder-quobyte-0dc87abe-2ce1-4176-befe-e1423c0f3d30-a66731b7-622e-4ace-844d-6b4d3ea207ea" released by "_create_volume_from_snapshot" :: held 4.869s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:26:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.882s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:26:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c51146c-7f79-4e01-98cd-da66ff2c9ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a66731b7-622e-4ace-844d-6b4d3ea207ea', 'volume_size': 1, 'snapshot_id': '0dc87abe-2ce1-4176-befe-e1423c0f3d30'}' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:26:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea19b645-2deb-4cbf-b725-a670f8f0ee32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:26:24 devstack cinder-volume[87084]: INFO cinder.volume.flows.manager.create_volume [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Volume volume-a66731b7-622e-4ace-844d-6b4d3ea207ea (a66731b7-622e-4ace-844d-6b4d3ea207ea): created successfully Sep 01 12:26:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea19b645-2deb-4cbf-b725-a670f8f0ee32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87084) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:26:24 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Flow 'volume_create_manager' (5c85a1a1-056f-4a2b-90a8-9c9a811d7444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87084) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:26:24 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-7be87caa-b548-49d4-a129-4c3eca14057a tempest-SnapshotDependencyTests-1346583661 None] Created volume successfully. Sep 01 12:26:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] Acquiring lock "cinder-0dc87abe-2ce1-4176-befe-e1423c0f3d30-delete_snapshot" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:26:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] Lock "cinder-0dc87abe-2ce1-4176-befe-e1423c0f3d30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:26:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] Acquiring lock "cinder-quobyte-2bc1123f-d7a1-4fd5-961c-284269087b77" by "delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:26:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] Lock "cinder-quobyte-2bc1123f-d7a1-4fd5-961c-284269087b77" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:26:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] Acquiring lock "cinder-quobyte-0dc87abe-2ce1-4176-befe-e1423c0f3d30" by "_delete_snapshot" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:26:24 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] Lock "cinder-quobyte-0dc87abe-2ce1-4176-befe-e1423c0f3d30" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:26:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] Deleting offline snapshot 0dc87abe-2ce1-4176-befe-e1423c0f3d30 of volume 2bc1123f-d7a1-4fd5-961c-284269087b77 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:26:24 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] snapshot_file for this snap is: volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30 {{(pid=87084) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:26:24 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85607e5-b15d-460a-9140-fd3d57c4cfd9]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:26:24 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:24 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30 Sep 01 12:26:24 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:25 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30" returned: 0 in 0.361s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:25 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.remotefs [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bc1123f-d7a1-4fd5-961c-284269087b77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87084) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:26:25 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85db9c5-a1a5-49dc-81b9-d13fdedc8b77]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:26:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:25 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77 Sep 01 12:26:25 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:25 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77" returned: 0 in 0.526s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:25 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30 Sep 01 12:26:25 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:25 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30" returned: 0 in 0.339s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:25 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:25 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30 Sep 01 12:26:25 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:26 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77.0dc87abe-2ce1-4176-befe-e1423c0f3d30" returned: 0 in 0.242s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] Lock "cinder-quobyte-0dc87abe-2ce1-4176-befe-e1423c0f3d30" released by "_delete_snapshot" :: held 1.558s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:26:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] Lock "cinder-quobyte-2bc1123f-d7a1-4fd5-961c-284269087b77" released by "delete_snapshot" :: held 1.580s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:26:26 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] Created reservations ['736dd40d-d55c-4eb8-bfa5-cdcb1007fa78', 'c9f5011d-d4a4-48d9-a4d1-9d7749867068', '050a1934-4ee9-433b-b8f7-3841e8f8ea7e', 'bafcdab7-3a3c-4572-a9da-a0e318db2acd'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:26:26 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] Delete snapshot completed successfully. Sep 01 12:26:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-a3ca8711-92de-4261-9fb0-0b40276fed96 tempest-SnapshotDependencyTests-1346583661 None] Lock "cinder-0dc87abe-2ce1-4176-befe-e1423c0f3d30-delete_snapshot" released by "delete_snapshot" :: held 1.704s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:26:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-446abc33-69c7-44b9-8504-fce56aa28046 tempest-SnapshotDependencyTests-1346583661 None] Acquiring lock "cinder-2bc1123f-d7a1-4fd5-961c-284269087b77-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:26:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-446abc33-69c7-44b9-8504-fce56aa28046 tempest-SnapshotDependencyTests-1346583661 None] Lock "cinder-2bc1123f-d7a1-4fd5-961c-284269087b77-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:26:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-446abc33-69c7-44b9-8504-fce56aa28046 tempest-SnapshotDependencyTests-1346583661 None] Acquiring lock "cinder-quobyte-2bc1123f-d7a1-4fd5-961c-284269087b77" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:26:26 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-446abc33-69c7-44b9-8504-fce56aa28046 tempest-SnapshotDependencyTests-1346583661 None] Lock "cinder-quobyte-2bc1123f-d7a1-4fd5-961c-284269087b77" acquired by "delete_volume" :: waited 0.014s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:26:26 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda100a0-0b2a-4c0e-9048-924862391e8e]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:26:26 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-446abc33-69c7-44b9-8504-fce56aa28046 tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:26 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77 Sep 01 12:26:26 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:27 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-446abc33-69c7-44b9-8504-fce56aa28046 tempest-SnapshotDependencyTests-1346583661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77" returned: 0 in 0.353s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-446abc33-69c7-44b9-8504-fce56aa28046 tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:27 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77 Sep 01 12:26:27 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:27 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-446abc33-69c7-44b9-8504-fce56aa28046 tempest-SnapshotDependencyTests-1346583661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-2bc1123f-d7a1-4fd5-961c-284269087b77" returned: 0 in 0.256s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-446abc33-69c7-44b9-8504-fce56aa28046 tempest-SnapshotDependencyTests-1346583661 None] Lock "cinder-quobyte-2bc1123f-d7a1-4fd5-961c-284269087b77" released by "delete_volume" :: held 0.668s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:26:27 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-446abc33-69c7-44b9-8504-fce56aa28046 tempest-SnapshotDependencyTests-1346583661 None] Created reservations ['0d1082e5-f8b3-4293-bff8-47da6845a19f', '54d8b299-fda3-4c16-8726-d0978eb66c86', '97cf36a5-5421-4b85-9346-e6eaec7c36fc', 'c6b10d25-beb6-4b6d-9749-1f8bc0b64240'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:26:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-446abc33-69c7-44b9-8504-fce56aa28046 tempest-SnapshotDependencyTests-1346583661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:26:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-446abc33-69c7-44b9-8504-fce56aa28046 tempest-SnapshotDependencyTests-1346583661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:26:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-446abc33-69c7-44b9-8504-fce56aa28046 tempest-SnapshotDependencyTests-1346583661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:26:27 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-446abc33-69c7-44b9-8504-fce56aa28046 tempest-SnapshotDependencyTests-1346583661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:26:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-446abc33-69c7-44b9-8504-fce56aa28046 tempest-SnapshotDependencyTests-1346583661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:26:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-446abc33-69c7-44b9-8504-fce56aa28046 tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:27 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:26:27 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:27 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-446abc33-69c7-44b9-8504-fce56aa28046 tempest-SnapshotDependencyTests-1346583661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.262s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:27 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-446abc33-69c7-44b9-8504-fce56aa28046 tempest-SnapshotDependencyTests-1346583661 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:26:27 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-446abc33-69c7-44b9-8504-fce56aa28046 tempest-SnapshotDependencyTests-1346583661 None] Deleted volume successfully. Sep 01 12:26:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-446abc33-69c7-44b9-8504-fce56aa28046 tempest-SnapshotDependencyTests-1346583661 None] Lock "cinder-2bc1123f-d7a1-4fd5-961c-284269087b77-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:26:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1267217d-d9bb-496f-afeb-29e5840f5d68 tempest-SnapshotDependencyTests-1346583661 None] Acquiring lock "cinder-a66731b7-622e-4ace-844d-6b4d3ea207ea-delete_volume" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:26:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1267217d-d9bb-496f-afeb-29e5840f5d68 tempest-SnapshotDependencyTests-1346583661 None] Lock "cinder-a66731b7-622e-4ace-844d-6b4d3ea207ea-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:26:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1267217d-d9bb-496f-afeb-29e5840f5d68 tempest-SnapshotDependencyTests-1346583661 None] Acquiring lock "cinder-quobyte-a66731b7-622e-4ace-844d-6b4d3ea207ea" by "delete_volume" {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:26:27 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1267217d-d9bb-496f-afeb-29e5840f5d68 tempest-SnapshotDependencyTests-1346583661 None] Lock "cinder-quobyte-a66731b7-622e-4ace-844d-6b4d3ea207ea" acquired by "delete_volume" :: waited 0.018s {{(pid=87084) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:26:27 devstack cinder-volume[87084]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4569bb8-27ef-41d9-8be0-47db25ea7b35]: (4, 'qcow2') {{(pid=88419) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:26:27 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1267217d-d9bb-496f-afeb-29e5840f5d68 tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a66731b7-622e-4ace-844d-6b4d3ea207ea {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:28 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a66731b7-622e-4ace-844d-6b4d3ea207ea Sep 01 12:26:28 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:28 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1267217d-d9bb-496f-afeb-29e5840f5d68 tempest-SnapshotDependencyTests-1346583661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a66731b7-622e-4ace-844d-6b4d3ea207ea" returned: 0 in 0.355s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1267217d-d9bb-496f-afeb-29e5840f5d68 tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a66731b7-622e-4ace-844d-6b4d3ea207ea {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:28 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a66731b7-622e-4ace-844d-6b4d3ea207ea Sep 01 12:26:28 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:28 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1267217d-d9bb-496f-afeb-29e5840f5d68 tempest-SnapshotDependencyTests-1346583661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881/volume-a66731b7-622e-4ace-844d-6b4d3ea207ea" returned: 0 in 0.248s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:28 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1267217d-d9bb-496f-afeb-29e5840f5d68 tempest-SnapshotDependencyTests-1346583661 None] Lock "cinder-quobyte-a66731b7-622e-4ace-844d-6b4d3ea207ea" released by "delete_volume" :: held 0.639s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:26:28 devstack cinder-volume[87084]: DEBUG cinder.quota [None req-1267217d-d9bb-496f-afeb-29e5840f5d68 tempest-SnapshotDependencyTests-1346583661 None] Created reservations ['25089fe4-3c12-4eff-8691-6e6990661778', 'a42c77e6-fa06-4b5f-94c4-a855e6728007', 'b2e6b547-2996-448f-890f-b7e0a1bbe4a9', '09990d8d-c038-4d34-9f40-53e55817bd44'] {{(pid=87084) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:26:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1267217d-d9bb-496f-afeb-29e5840f5d68 tempest-SnapshotDependencyTests-1346583661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:26:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1267217d-d9bb-496f-afeb-29e5840f5d68 tempest-SnapshotDependencyTests-1346583661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:26:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1267217d-d9bb-496f-afeb-29e5840f5d68 tempest-SnapshotDependencyTests-1346583661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:26:28 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-1267217d-d9bb-496f-afeb-29e5840f5d68 tempest-SnapshotDependencyTests-1346583661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:26:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-1267217d-d9bb-496f-afeb-29e5840f5d68 tempest-SnapshotDependencyTests-1346583661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:26:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1267217d-d9bb-496f-afeb-29e5840f5d68 tempest-SnapshotDependencyTests-1346583661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:28 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:26:28 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:28 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:28 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-1267217d-d9bb-496f-afeb-29e5840f5d68 tempest-SnapshotDependencyTests-1346583661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.255s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:28 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-1267217d-d9bb-496f-afeb-29e5840f5d68 tempest-SnapshotDependencyTests-1346583661 None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:26:28 devstack cinder-volume[87084]: INFO cinder.volume.manager [None req-1267217d-d9bb-496f-afeb-29e5840f5d68 tempest-SnapshotDependencyTests-1346583661 None] Deleted volume successfully. Sep 01 12:26:29 devstack cinder-volume[87084]: DEBUG cinder.coordination [None req-1267217d-d9bb-496f-afeb-29e5840f5d68 tempest-SnapshotDependencyTests-1346583661 None] Lock "cinder-a66731b7-622e-4ace-844d-6b4d3ea207ea-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87084) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:26:38 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:SELECT=26,cinder:INSERT=9,cinder:UPDATE=23,cinder:DELETE=3 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:26:38 devstack cinder-volume[87084]: DEBUG dbcounter [-] [87084] Writing DB stats cinder:UPDATE=35,cinder:SELECT=23,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:26:41 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:26:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:26:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:26:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1': None} {{(pid=87084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:26:41 devstack cinder-volume[87084]: DEBUG cinder.volume.drivers.quobyte [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-45609e5c-6a0e-436d-b1ef-4d40c8e94cf1'] {{(pid=87084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:26:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.lockutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:26:41 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:26:41 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881 Sep 01 12:26:41 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:26:42 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 01 12:26:42 devstack cinder-volume[87084]: DEBUG oslo_concurrency.processutils [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a7574b3cc7869ad47cc22ef56894f881" returned: 0 in 0.226s {{(pid=87084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:26:42 devstack cinder-volume[87084]: DEBUG cinder.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Notifying Schedulers of capabilities ... {{(pid=87084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:26:42 devstack cinder-volume[87084]: DEBUG oslo_service.periodic_task [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] Running periodic task VolumeManager._thread_info {{(pid=87084) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:26:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread count: 28 {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:26:42 devstack cinder-volume[87084]: DEBUG cinder.volume.manager [None req-b192a980-faa1-499e-9dbf-cf72796d234f None None] thread info: [<_MainThread(MainThread, started 138561610330240)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87084) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}